-- Logs begin at Sat 2022-06-04 20:01:18 UTC, end at Sat 2022-06-04 21:02:17 UTC. -- Jun 04 20:34:08.133564 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jun 04 20:34:08.145413 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 4 20:34:08 2022] *** Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: nodename: dv-osbrick-master-4-ceph Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: machine: x86_64 Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: clock source: unix Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: pcre jit disabled Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: detected number of CPU cores: 4 Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: current working directory: / Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: detected binary path: /usr/bin/uwsgi-core Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: your processes number limit is 47680 Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: your memory page size is 4096 bytes Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: detected max file descriptor number: 2048 Jun 04 20:34:08.147476 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: lock engine: pthread robust mutexes Jun 04 20:34:08.148340 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: thunder lock: enabled Jun 04 20:34:08.148340 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 04 20:34:08.148340 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 04 20:34:08.195611 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: Python main interpreter initialized at 0x55de77b9d9c0 Jun 04 20:34:08.195611 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: python threads support enabled Jun 04 20:34:08.195611 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: your server socket listen backlog is limited to 100 connections Jun 04 20:34:08.195611 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: your mercy for graceful operations on workers is 90 seconds Jun 04 20:34:08.196000 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: mapped 403077 bytes (393 KB) for 2 cores Jun 04 20:34:08.196000 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: *** Operational MODE: preforking *** Jun 04 20:34:08.196315 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: *** uWSGI is running in multiple interpreter mode *** Jun 04 20:34:08.196315 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: spawned uWSGI master process (pid: 98923) Jun 04 20:34:08.196583 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Jun 04 20:34:08.197118 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: spawned uWSGI worker 1 (pid: 98932, cores: 1) Jun 04 20:34:08.197474 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: spawned uWSGI worker 2 (pid: 98933, cores: 1) Jun 04 20:34:08.198453 dv-osbrick-master-4-ceph devstack@keystone.service[98923]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 04 20:34:13.965082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:34:13.965082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: from cryptography.utils import int_from_bytes Jun 04 20:34:13.965930 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:34:13.965930 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: from cryptography.utils import int_from_bytes Jun 04 20:34:13.987458 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:34:13.987458 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: from cryptography.utils import int_from_bytes Jun 04 20:34:13.988260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 04 20:34:13.988260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: from cryptography.utils import int_from_bytes Jun 04 20:34:14.015922 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 20:34:14.016185 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 20:34:14.016324 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] command line args: [] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 20:34:14.016598 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 20:34:14.016774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ================================================================================ {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 20:34:14.017045 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] admin_token = **** {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.017293 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] config_dir = [] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.017493 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.017671 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] config_source = [] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.017854 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] debug = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.018050 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.018747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.018911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.019175 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.019425 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.019657 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] list_limit = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.019838 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] log_config_append = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.020023 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.020191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] log_dir = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.020363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] log_file = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.020648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.020863 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.021114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.021362 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.021522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.021703 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.021950 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.022194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.022443 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.024315 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.024670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.024929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.025200 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.025464 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.025755 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.026277 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.026466 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] publish_errors = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.026706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.026940 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.027122 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.027373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.027613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.027853 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] standard_threads = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.028140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.028332 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.028537 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.028820 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] use_journal = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.029002 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] use_json = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.029300 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] use_stderr = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.029447 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] use_syslog = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.029596 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.029821 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.030062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.030328 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.030573 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.030826 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.031070 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.031319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.031555 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.031802 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.032051 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.032303 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.032563 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.032813 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.033047 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.033295 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.033558 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.033764 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.034018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.034481 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.034648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.034815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.034990 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.035257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.035510 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.035764 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.035993 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.036223 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.036357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 04 20:34:14.036523 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 04 20:34:14.036664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.036868 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] command line args: [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 04 20:34:14.037025 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.037179 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 04 20:34:14.037317 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.037457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ================================================================================ {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 04 20:34:14.037595 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.037741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] admin_token = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.037873 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.038006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] config_dir = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.038136 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.038267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.038398 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.038541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] config_source = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.038674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.038806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] debug = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.038806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.039094 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.039241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.039381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.039515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.039653 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.039786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.039920 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.040062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.040201 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.040344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.040515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.040661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_config_append = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.040796 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.040945 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.041080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.041219 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_dir = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.041219 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_file = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.041479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.041479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.041853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.041987 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.042120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.042254 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.042386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.042524 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.042714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.042854 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.042993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.042993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.043258 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.043400 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.043534 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.043673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.043806 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.043806 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.044074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.044221 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.044528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.044688 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.044846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.045008 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.045151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.045329 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.045466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.045601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.045601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.045601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.045601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.045601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.045601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.045601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.045601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.046599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.046732 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.046871 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.047006 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.047006 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.047283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.047421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.047646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] publish_errors = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.047781 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.047919 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.048054 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.048191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.048336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.048503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.048639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.048771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.048946 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.049078 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.049225 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.049358 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] standard_threads = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.049499 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.049641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.049772 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.049909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.050054 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.050194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.050194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] use_journal = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.050455 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.050602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] use_json = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.050733 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.050879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] use_stderr = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.051065 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.051223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] use_syslog = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.051481 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.051620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 04 20:34:14.051760 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.051903 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.052038 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.052176 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.052310 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.052500 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.052639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.052786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.052919 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.053051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.053190 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.053323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.053455 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.053598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.053739 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.053911 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.054045 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.054185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.054319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.054463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.054645 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.054792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.054925 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.055058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.055190 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.055190 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.055452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.055585 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.055717 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.055852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.055983 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.056131 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.056307 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.056463 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.056610 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.056745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.056888 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.057030 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.057165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.057306 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.057441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.057582 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.057716 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.057849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] auth.external = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.057999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.058135 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.058315 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.058486 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.058623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.058762 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.058912 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.059047 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] auth.password = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.059180 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.059314 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] auth.token = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.059446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.059579 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.059721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.059860 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.060027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.060161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.060294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.060458 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.060611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.060747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.060882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.061027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.061169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.061313 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.061449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.061589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] credential.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.061724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.061864 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.061999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.062143 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.062279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.062412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.062546 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.062681 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.062814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.063036 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.063181 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.063317 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.063453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.063601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.063767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.063924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.064065 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.064217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.064357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.064573 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.064708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.064856 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.064991 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.064991 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.065246 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.065379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.065514 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.065664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.065664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.065948 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.066161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.066307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.066443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.066576 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] federation.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.066720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.066862 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.067003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.067136 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.067269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.067403 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.067546 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.067679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.067818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.067952 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.068086 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.068220 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.068362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.068539 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.068683 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.068824 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.068963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.069109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.069258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.069398 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.069543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.069699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.069839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.069985 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.070134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.070281 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.070427 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.070601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.070749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.070897 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.071044 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.071186 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.071335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.071476 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.071476 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.071752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.071893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.072034 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.072183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.072324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.072536 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.072685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.072824 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.072958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.073102 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.073238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.073373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.073507 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.073648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.073824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.073969 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.074104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.074238 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.074371 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.074509 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.074642 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.075268 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.075461 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.075751 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.075909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.076135 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.076270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.076469 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.076627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.076782 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.076940 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.077146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.077317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.077469 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.077675 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.077844 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.078004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.078110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.078412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.078570 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.078725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.078903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.079077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.079220 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.079370 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.079533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.079695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.079858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.080017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.080171 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.080322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.080636 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.080796 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.080935 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.081087 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.081270 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.081441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.081591 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.081797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.081979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.082158 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.082366 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.082505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.082697 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.082882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.083017 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.083198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.083412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.083601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.083806 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.084003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.external = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.084197 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.084384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.084802 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.084802 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.085194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.085374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.085545 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.085721 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.085894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.password = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.085894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.token = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.086251 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.086251 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.086587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.086587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.086915 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.086915 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.087280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.087280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.087618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.087800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.087992 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.088187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.088393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.088589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.088734 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.088862 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.088989 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.089130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.089260 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.089390 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.089519 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.089648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.089776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.089913 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.090059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.090189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.090318 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.090460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.090598 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.090735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.090865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.090993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.091121 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.091283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.091413 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.091551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.091689 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.091818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.091946 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.092074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.092202 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.092351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.092538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.092538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.092818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.092818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.093067 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.093208 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.093338 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.093467 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.093624 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.093624 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.093873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.094010 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.094153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.094281 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.094408 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.094536 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.094666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.094840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.094985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.095114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.095242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.095370 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.095497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.095639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.095770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.095899 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.096047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.096178 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.096306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.096517 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.096654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.096784 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.096912 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.097040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.097167 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.097308 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.097438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.097567 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.097694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.097823 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] resource.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.097960 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.098098 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.098228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.098484 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.098632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.098762 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.098891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.099028 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.099158 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.099295 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.099425 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.099553 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.099682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.099830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.099960 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.100087 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.100215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.100350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.100513 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.100667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] role.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.100798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.100927 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] role.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.100927 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.101168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.101297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.101434 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.101566 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.101706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.101835 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.101964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.102101 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.102231 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.102359 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.102489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.102625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.102754 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.102891 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.103021 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.103148 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.103276 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.103415 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.103544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.103680 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.103810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.103945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.104075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.104202 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.104330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.104525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.104670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.104670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.104913 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.105041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.105169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.105322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.105322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.105573 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.105701 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.105957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.105957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.106209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.106337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.106465 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.106593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.106721 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.106920 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.107115 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.107288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.107459 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.107628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.107774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.107970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.108115 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.108247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.108375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.108580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.108710 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.108925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.109056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.109195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.109325 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.109452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.109580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.109716 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.109845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.109972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.110099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.110227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.110356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.110492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.110631 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] token.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.110760 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.110887 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.111024 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.111152 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.111288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.111418 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.111545 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.111672 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.111800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.111935 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.112063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.112191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.112319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.112468 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.112602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.112742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.112884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.113013 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.113140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.113267 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.113394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.113532 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.113661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.113789 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.113917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.114044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.114171 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.114306 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.114306 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.114561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.114689 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.114816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.114816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.115065 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.115194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.115322 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.connection = **** {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.115459 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.115599 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.115728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.115982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.116118 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.116247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.116384 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.116598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.116728 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.116856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.116995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.116995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.117236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.117364 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.117491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.117618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.117756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.117886 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.118013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.118141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.118278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.118406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.118555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.118687 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.118815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.118942 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.119069 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.119195 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.119331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.119461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.119588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.119716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.119845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.119972 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.120118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.120248 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 20:34:14.120376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.120376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.120376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.120376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.120376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.120376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.120376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.120376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.120376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.121471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.121471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] role.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.121471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] role.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.121471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.121471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.121471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.121471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.121471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.121471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.122653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.122653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.122653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.122653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.122653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.122653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.122653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.122653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.122653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.123869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.123869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.123869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.123869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.123869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.123869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.123869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.123869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.123869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.124976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.124976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.124976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.124976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.124976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.124976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.124976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.124976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.124976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.126140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.126140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.126140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.126140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.126140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.126140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.126140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.126140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.126140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.127196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.127196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.127196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.127196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.127196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.127196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.127196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.127196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.127196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.128246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.connection = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.128246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.128246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.128246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.128246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.128246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.128246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.129342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.129342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.129342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.129735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.130175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.130590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.131032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.131475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.131961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.132350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.132634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.132881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 04 20:34:14.133059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 04 20:34:14.134637 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.134868 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.135095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.145249 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.160942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.161202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.161385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.170335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.174230 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.174460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.201384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.201723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.234383 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.251415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.285408 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.285649 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.288016 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.288255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.357283 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.357707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.357881 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.358008 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.358138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.358265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.358392 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.358525 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.358648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.358764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.358764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.358900 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.382862 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.383095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.383184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.383261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.383336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.383488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.383586 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.383708 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.383800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.383920 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.384003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.384129 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.384213 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.384337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.396264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.396507 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.409461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.409689 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.409831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.409919 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.409993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.410066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.410149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.410270 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.410361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.410508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.410600 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.410684 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98932) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.410760 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.410957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 04 20:34:14.428117 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.428309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.428417 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 20:34:14.428535 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 20:34:14.428661 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.428865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.428957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 20:34:14.429061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 04 20:34:14.429156 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.429319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.429403 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.429578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.429667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.429835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.429923 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.430090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.440922 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.441205 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.441469 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.441580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.441742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.441896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.442138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.442614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.449876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.450880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.453333 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.453612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.453890 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.454165 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.454348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.454432 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.454630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.454712 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.454911 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.455001 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.455178 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.455257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.455464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.455542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.455723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.455802 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.455988 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.456066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.456258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.456561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.456834 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.457198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.482652 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.484323 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.484681 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.490022 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.490298 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.490389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.490568 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.492392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.492703 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.498195 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.498381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.498524 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.498660 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.498909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.503096 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.503376 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.503651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.503927 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.506607 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.506607 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.506607 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.506607 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.512393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.512852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.521338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.521796 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.522280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.523365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.523365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.523365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.523754 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.523964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.524905 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.525224 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.530253 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.534188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.534480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.539518 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.543129 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.544254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.544693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.546808 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.547104 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.547366 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.547767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.548051 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.548336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.549996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.553730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.554023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.559089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.562860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.566551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.566855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.567159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.567420 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.567529 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.567719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.567812 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.567974 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.568130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.568266 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.577962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.579682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.579961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.583052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.583325 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.583602 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.583877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.584147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.587341 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.587644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.587913 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.588177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.597634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.597928 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.598210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.598349 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.598480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.598748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.599017 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.599303 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.600110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.600409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.603501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.603767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.604048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.604348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.604669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.617474 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.618213 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.618502 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.618791 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.619072 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.619350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.619620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.619893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.620896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.624499 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.626098 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.627711 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.627981 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.628269 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.635708 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.637361 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.637965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.640760 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.641048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.641323 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.641545 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.641638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.645303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.646967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.648648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.648929 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.649199 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.650996 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.651287 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.651562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.656882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.658645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.659567 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98932) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.659847 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.660115 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.660372 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.660663 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.660926 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.661199 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.661475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.661755 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.661906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.662032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.662201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.662348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.662475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.662599 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.662750 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.662854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.663022 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98932) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.672250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.672563 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.672848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.680932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 04 20:34:14.681213 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.681491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.681764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.682037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.682305 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.682567 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.682842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.683106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.683387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.683656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.683921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.684184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.684441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 04 20:34:14.701207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de77b9d9c0 pid: 98932 (default app) Jun 04 20:34:14.704661 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10004177-3571-460a-90dc-f43451f1d58b None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:14.704952 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10004177-3571-460a-90dc-f43451f1d58b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:14.705227 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10004177-3571-460a-90dc-f43451f1d58b None None] PATH_INFO: `/v3` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:14.710317 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 791 bytes} [Sat Jun 4 20:34:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:14.723078 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55de77b9d9c0 pid: 98933 (default app) Jun 04 20:34:23.112703 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1dd42-e4b0-4cf7-bc7f-5f358f28c77e None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:23.113306 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1dd42-e4b0-4cf7-bc7f-5f358f28c77e None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:23.113306 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1dd42-e4b0-4cf7-bc7f-5f358f28c77e None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:23.114606 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:34:23.122548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c64b5e-2d2f-40c9-bfd2-f68e5534ef28 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:23.123081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c64b5e-2d2f-40c9-bfd2-f68e5534ef28 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:23.123081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c64b5e-2d2f-40c9-bfd2-f68e5534ef28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:23.196474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: INFO dbcounter [None req-b2c64b5e-2d2f-40c9-bfd2-f68e5534ef28 None None] Registered counter for database keystone Jun 04 20:34:23.218187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG oslo_db.sqlalchemy.engines [None req-b2c64b5e-2d2f-40c9-bfd2-f68e5534ef28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:34:23.225242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writer thread running {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:34:23.519623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG passlib.handlers.bcrypt [None req-b2c64b5e-2d2f-40c9-bfd2-f68e5534ef28 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98933) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 04 20:34:23.520105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG passlib.handlers.bcrypt [None req-b2c64b5e-2d2f-40c9-bfd2-f68e5534ef28 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98933) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 04 20:34:23.579745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-b2c64b5e-2d2f-40c9-bfd2-f68e5534ef28 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:23.581421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-b2c64b5e-2d2f-40c9-bfd2-f68e5534ef28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:23.729970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 1/3] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 611 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 04 20:34:23.928947 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1dd42-e4b0-4cf7-bc7f-5f358f28c77e None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:24.019448 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: INFO dbcounter [None req-34b1dd42-e4b0-4cf7-bc7f-5f358f28c77e None None] Registered counter for database keystone Jun 04 20:34:24.049976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG oslo_db.sqlalchemy.engines [None req-34b1dd42-e4b0-4cf7-bc7f-5f358f28c77e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 04 20:34:24.059133 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writer thread running {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 04 20:34:24.300310 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1dd42-e4b0-4cf7-bc7f-5f358f28c77e None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:24.306683 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fd07e-8d20-43c3-895d-e74617f0fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:24.307685 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd07e-8d20-43c3-895d-e74617f0fb5f admin admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:24.307970 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd07e-8d20-43c3-895d-e74617f0fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:24.308251 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fd07e-8d20-43c3-895d-e74617f0fb5f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:24.318363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fd07e-8d20-43c3-895d-e74617f0fb5f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:24.375954 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6a6fd07e-8d20-43c3-895d-e74617f0fb5f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 04 20:34:24.376321 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fd07e-8d20-43c3-895d-e74617f0fb5f admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:24.388402 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 3/4] 10.222.0.24 () {58 vars in 1324 bytes} [Sat Jun 4 20:34:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 04 20:34:24.395882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c64b5e-2d2f-40c9-bfd2-f68e5534ef28 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:24.414803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c64b5e-2d2f-40c9-bfd2-f68e5534ef28 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:24.421093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6b29d-ffbf-457f-b0af-7fd6ad4e20a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:24.422309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6b29d-ffbf-457f-b0af-7fd6ad4e20a7 admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:24.422724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6b29d-ffbf-457f-b0af-7fd6ad4e20a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:24.423005 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6b29d-ffbf-457f-b0af-7fd6ad4e20a7 admin admin] PATH_INFO: `/v3/projects/a16b8488457e4e38a2b3d336cfdffb59` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:24.424979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6b29d-ffbf-457f-b0af-7fd6ad4e20a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=a16b8488457e4e38a2b3d336cfdffb59)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:24.481983 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1ee6b29d-ffbf-457f-b0af-7fd6ad4e20a7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 04 20:34:24.482444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6b29d-ffbf-457f-b0af-7fd6ad4e20a7 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:24.487733 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 2/5] 10.222.0.24 () {56 vars in 1207 bytes} [Sat Jun 4 20:34:24 2022] GET /identity/v3/projects/a16b8488457e4e38a2b3d336cfdffb59 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:26.904844 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b565f-66e5-4ee0-a385-de58926f51ab None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:26.905379 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b565f-66e5-4ee0-a385-de58926f51ab None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:26.905379 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b565f-66e5-4ee0-a385-de58926f51ab None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:26.909577 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 4/6] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:26.916043 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f121fb-dd82-4fa4-869c-b3b94e0b0e8c None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:26.916598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f121fb-dd82-4fa4-869c-b3b94e0b0e8c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:26.916719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f121fb-dd82-4fa4-869c-b3b94e0b0e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:26.937883 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-24f121fb-dd82-4fa4-869c-b3b94e0b0e8c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:26.939476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-24f121fb-dd82-4fa4-869c-b3b94e0b0e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:26.949263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 3/7] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 04 20:34:26.973444 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b565f-66e5-4ee0-a385-de58926f51ab None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:26.987738 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b565f-66e5-4ee0-a385-de58926f51ab None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:26.992915 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0545f3e-9092-461d-84c1-933f65af169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:26.993577 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0545f3e-9092-461d-84c1-933f65af169c admin admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:26.993860 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0545f3e-9092-461d-84c1-933f65af169c admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:26.994132 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0545f3e-9092-461d-84c1-933f65af169c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:27.004699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0545f3e-9092-461d-84c1-933f65af169c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:27.005859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0545f3e-9092-461d-84c1-933f65af169c admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:27.017038 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 5/8] 10.222.0.24 () {58 vars in 1324 bytes} [Sat Jun 4 20:34:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 04 20:34:27.023719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f121fb-dd82-4fa4-869c-b3b94e0b0e8c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:27.034652 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f121fb-dd82-4fa4-869c-b3b94e0b0e8c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:27.040468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea3fd1-3e8f-46da-9ba5-d92fabfc7960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:27.041381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea3fd1-3e8f-46da-9ba5-d92fabfc7960 admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:27.041662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea3fd1-3e8f-46da-9ba5-d92fabfc7960 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:27.041934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea3fd1-3e8f-46da-9ba5-d92fabfc7960 admin admin] PATH_INFO: `/v3/users/64937d35ffd9426ca7084e0272d22ff3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:27.043536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea3fd1-3e8f-46da-9ba5-d92fabfc7960 admin admin] RBAC: Authorizing `identity:get_user(user_id=64937d35ffd9426ca7084e0272d22ff3)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:27.045782 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ea3fd1-3e8f-46da-9ba5-d92fabfc7960 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:27.047519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 4/9] 10.222.0.24 () {56 vars in 1198 bytes} [Sat Jun 4 20:34:27 2022] GET /identity/v3/users/64937d35ffd9426ca7084e0272d22ff3 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:29.545087 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a3bb-ab1f-4cfc-af5f-6c8d0ebf39d1 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:29.545655 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a3bb-ab1f-4cfc-af5f-6c8d0ebf39d1 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:29.545655 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b1a3bb-ab1f-4cfc-af5f-6c8d0ebf39d1 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:29.547034 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:29.552798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bc416-5de9-41cc-b44a-aaddea7f3beb None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:29.553341 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bc416-5de9-41cc-b44a-aaddea7f3beb None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:29.553341 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9bc416-5de9-41cc-b44a-aaddea7f3beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:29.559815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d8d59-302e-4103-846a-9e781bae6c6f None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:29.560370 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d8d59-302e-4103-846a-9e781bae6c6f None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:29.560370 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d8d59-302e-4103-846a-9e781bae6c6f None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:29.562009 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 7/11] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:29.568076 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5503b5f-0a30-4544-9536-c93d37174a92 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:29.568365 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5503b5f-0a30-4544-9536-c93d37174a92 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:29.568677 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5503b5f-0a30-4544-9536-c93d37174a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:29.572506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-de9bc416-5de9-41cc-b44a-aaddea7f3beb None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:29.573755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-de9bc416-5de9-41cc-b44a-aaddea7f3beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:29.612625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG passlib.handlers.bcrypt [None req-c5503b5f-0a30-4544-9536-c93d37174a92 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98932) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 04 20:34:29.613039 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG passlib.handlers.bcrypt [None req-c5503b5f-0a30-4544-9536-c93d37174a92 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98932) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 04 20:34:29.659691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-c5503b5f-0a30-4544-9536-c93d37174a92 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:29.661380 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-c5503b5f-0a30-4544-9536-c93d37174a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:29.666431 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 5/12] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:29.689669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bc416-5de9-41cc-b44a-aaddea7f3beb None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:29.714714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:29.766355 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 8/13] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:29.791525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5503b5f-0a30-4544-9536-c93d37174a92 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:29.803769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9bc416-5de9-41cc-b44a-aaddea7f3beb None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:29.848446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c5baf-43d2-41a9-8aae-f7b4b9ff0e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:29.849121 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5baf-43d2-41a9-8aae-f7b4b9ff0e7b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:29.849404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5baf-43d2-41a9-8aae-f7b4b9ff0e7b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:29.849682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5baf-43d2-41a9-8aae-f7b4b9ff0e7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:29.901895 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5503b5f-0a30-4544-9536-c93d37174a92 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:29.904279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:29.919743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c5baf-43d2-41a9-8aae-f7b4b9ff0e7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:29.921301 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c5baf-43d2-41a9-8aae-f7b4b9ff0e7b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:29.940593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da4b9c-4754-407e-8bf5-79ebd7dd6326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:29.941814 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da4b9c-4754-407e-8bf5-79ebd7dd6326 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:29.941944 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da4b9c-4754-407e-8bf5-79ebd7dd6326 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:29.942229 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da4b9c-4754-407e-8bf5-79ebd7dd6326 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:29.944540 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:29.955982 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da4b9c-4754-407e-8bf5-79ebd7dd6326 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-d8da4b9c-4754-407e-8bf5-79ebd7dd6326 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:29.967706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:29.968840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:34:29.969831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 9/14] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:34:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:29.976755 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da4b9c-4754-407e-8bf5-79ebd7dd6326 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:30.038792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 6/15] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:34:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:34:30.044498 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c5baf-43d2-41a9-8aae-f7b4b9ff0e7b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:30.088641 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da4b9c-4754-407e-8bf5-79ebd7dd6326 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:30.130864 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a691b-8e54-4892-90e0-c1a71ff755f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:30.131563 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a691b-8e54-4892-90e0-c1a71ff755f7 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:30.131853 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a691b-8e54-4892-90e0-c1a71ff755f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:30.132131 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a691b-8e54-4892-90e0-c1a71ff755f7 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:30.132947 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a691b-8e54-4892-90e0-c1a71ff755f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:30.133258 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a691b-8e54-4892-90e0-c1a71ff755f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:30.134750 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a691b-8e54-4892-90e0-c1a71ff755f7 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:30.148696 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 10/16] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:34:30.153137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c5baf-43d2-41a9-8aae-f7b4b9ff0e7b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:30.154849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a691b-8e54-4892-90e0-c1a71ff755f7 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:30.178423 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:30.189422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:30.191992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ba55-7732-4980-b470-80a436d42fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:30.193355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ba55-7732-4980-b470-80a436d42fda None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:30.193711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ba55-7732-4980-b470-80a436d42fda None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:30.194049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2ba55-7732-4980-b470-80a436d42fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:30.207179 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2ba55-7732-4980-b470-80a436d42fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:30.208743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2ba55-7732-4980-b470-80a436d42fda None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-7ca2ba55-7732-4980-b470-80a436d42fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:34:30.232278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:30.233330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:30.234381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:34:30.234381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:34:30.234381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:34:30.234381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:34:30.234381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 7/17] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:30.239489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ba55-7732-4980-b470-80a436d42fda None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:30.275838 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a691b-8e54-4892-90e0-c1a71ff755f7 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:30.311908 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb7f3-ced2-4ede-a8bc-f8e1e3d4deaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:30.312756 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb7f3-ced2-4ede-a8bc-f8e1e3d4deaa None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:30.313317 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb7f3-ced2-4ede-a8bc-f8e1e3d4deaa None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:30.313317 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efb7f3-ced2-4ede-a8bc-f8e1e3d4deaa None admin] PATH_INFO: `/v3/users/64937d35ffd9426ca7084e0272d22ff3` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:30.315158 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efb7f3-ced2-4ede-a8bc-f8e1e3d4deaa None admin] RBAC: Authorizing `identity:get_user(user_id=64937d35ffd9426ca7084e0272d22ff3)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:30.316701 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85efb7f3-ced2-4ede-a8bc-f8e1e3d4deaa None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:30.318653 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 11/18] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:30 2022] GET /identity/v3/users/64937d35ffd9426ca7084e0272d22ff3 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:34:30.324260 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb7f3-ced2-4ede-a8bc-f8e1e3d4deaa None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:30.343750 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2ba55-7732-4980-b470-80a436d42fda None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:30.379250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb80e9e-c5a1-495c-89d4-3c6bd15c9d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:30.379923 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb80e9e-c5a1-495c-89d4-3c6bd15c9d91 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:30.380338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb80e9e-c5a1-495c-89d4-3c6bd15c9d91 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:30.380553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb80e9e-c5a1-495c-89d4-3c6bd15c9d91 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:30.381310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb80e9e-c5a1-495c-89d4-3c6bd15c9d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:30.381720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb80e9e-c5a1-495c-89d4-3c6bd15c9d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:30.383145 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb80e9e-c5a1-495c-89d4-3c6bd15c9d91 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:30.401545 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 8/19] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:30.429446 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:30.437057 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efb7f3-ced2-4ede-a8bc-f8e1e3d4deaa None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:30.476007 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695c6db-495a-45c3-93e9-c8514cea6164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:30.476899 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c6db-495a-45c3-93e9-c8514cea6164 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:30.477183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c6db-495a-45c3-93e9-c8514cea6164 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:30.477468 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695c6db-495a-45c3-93e9-c8514cea6164 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:30.478741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695c6db-495a-45c3-93e9-c8514cea6164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:30.480224 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695c6db-495a-45c3-93e9-c8514cea6164 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:30.482154 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 12/20] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:34:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:34:30.488228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb80e9e-c5a1-495c-89d4-3c6bd15c9d91 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:30.531064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:30.613567 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb80e9e-c5a1-495c-89d4-3c6bd15c9d91 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:30.653743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926e220c-c143-4eaa-8f7d-d543867d2572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:30.654427 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e220c-c143-4eaa-8f7d-d543867d2572 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:30.654718 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e220c-c143-4eaa-8f7d-d543867d2572 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:30.655005 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926e220c-c143-4eaa-8f7d-d543867d2572 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:30.655857 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e220c-c143-4eaa-8f7d-d543867d2572 None admin] RBAC: Adding query filter params (role.id=f315b062be7e445fa9461a116f9c46ee, scope.domain.id=default, user.id=64937d35ffd9426ca7084e0272d22ff3) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:30.656177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e220c-c143-4eaa-8f7d-d543867d2572 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:30.657746 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926e220c-c143-4eaa-8f7d-d543867d2572 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:30.667839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 9/21] 10.222.0.24 () {56 vars in 1322 bytes} [Sat Jun 4 20:34:30 2022] GET /identity/v3/role_assignments?user.id=64937d35ffd9426ca7084e0272d22ff3&scope.domain.id=default&role.id=f315b062be7e445fa9461a116f9c46ee => generated 233 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:33.167673 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8644-ed85-4cf9-b052-d6998e8bfd79 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:33.168750 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8644-ed85-4cf9-b052-d6998e8bfd79 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:33.169988 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc8644-ed85-4cf9-b052-d6998e8bfd79 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:33.171725 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 13/22] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:34:33.186273 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27a841-8a80-43f9-a010-9af5661ca8ee None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:33.186273 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27a841-8a80-43f9-a010-9af5661ca8ee None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:33.186273 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a27a841-8a80-43f9-a010-9af5661ca8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:33.214159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-3a27a841-8a80-43f9-a010-9af5661ca8ee None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:33.215781 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-3a27a841-8a80-43f9-a010-9af5661ca8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:33.311968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 10/23] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:33.350128 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8644-ed85-4cf9-b052-d6998e8bfd79 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:33.358455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af690938-8fb0-458a-a901-9e8646b666e9 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:33.359067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af690938-8fb0-458a-a901-9e8646b666e9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:33.359555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af690938-8fb0-458a-a901-9e8646b666e9 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:33.361188 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 11/24] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:33.370267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe2e70-734c-40f7-aee0-b9140e83f2e3 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:33.370877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe2e70-734c-40f7-aee0-b9140e83f2e3 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:33.371401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe2e70-734c-40f7-aee0-b9140e83f2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:33.405514 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-83fe2e70-734c-40f7-aee0-b9140e83f2e3 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:33.407095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-83fe2e70-734c-40f7-aee0-b9140e83f2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:33.467811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:33.548170 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc8644-ed85-4cf9-b052-d6998e8bfd79 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:33.591846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 12/25] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:34:33.594682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d596b0-b565-4998-bb7a-72272c8f38e9 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:33.595347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d596b0-b565-4998-bb7a-72272c8f38e9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:33.596647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d596b0-b565-4998-bb7a-72272c8f38e9 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:33.599771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 13/26] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:33.606663 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7407d-68f8-4b1a-acd0-97e153ab6afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:33.607435 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7407d-68f8-4b1a-acd0-97e153ab6afd None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:33.607720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7407d-68f8-4b1a-acd0-97e153ab6afd None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:33.608003 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7407d-68f8-4b1a-acd0-97e153ab6afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:33.608737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4c54-c295-482d-95e3-4ae5394f9009 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:33.609169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4c54-c295-482d-95e3-4ae5394f9009 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:33.609584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddf4c54-c295-482d-95e3-4ae5394f9009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:33.637604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7407d-68f8-4b1a-acd0-97e153ab6afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:33.639220 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7407d-68f8-4b1a-acd0-97e153ab6afd None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:33.643989 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-0ddf4c54-c295-482d-95e3-4ae5394f9009 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:33.645235 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0ddf4c54-c295-482d-95e3-4ae5394f9009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-a2b7407d-68f8-4b1a-acd0-97e153ab6afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:34:33.673326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:33.674375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:33.675356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:34:33.675356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:34:33.675356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:34:33.675356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:34:33.675356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 14/27] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:34:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:33.675356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7407d-68f8-4b1a-acd0-97e153ab6afd None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:33.700855 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:33.817665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 14/28] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:33.818480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf4c54-c295-482d-95e3-4ae5394f9009 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:33.866457 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7407d-68f8-4b1a-acd0-97e153ab6afd None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:33.939140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0767be1-30c5-42d2-bc71-db0b6ffe87dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:33.939830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0767be1-30c5-42d2-bc71-db0b6ffe87dd None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:33.940117 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0767be1-30c5-42d2-bc71-db0b6ffe87dd None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:33.940394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0767be1-30c5-42d2-bc71-db0b6ffe87dd None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:33.941192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0767be1-30c5-42d2-bc71-db0b6ffe87dd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:33.942608 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0767be1-30c5-42d2-bc71-db0b6ffe87dd None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:34.000907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:34.024848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddf4c54-c295-482d-95e3-4ae5394f9009 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:34.105388 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 15/29] 10.222.0.24 () {60 vars in 1131 bytes} [Sat Jun 4 20:34:33 2022] POST /identity/v3/roles => generated 219 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:34:34.106616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0767be1-30c5-42d2-bc71-db0b6ffe87dd None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:34.116558 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d8fb5-af28-4c1f-ac93-1e9055549d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:34.117270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d8fb5-af28-4c1f-ac93-1e9055549d06 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:34.117557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d8fb5-af28-4c1f-ac93-1e9055549d06 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:34.117840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d8fb5-af28-4c1f-ac93-1e9055549d06 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:34.118624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d8fb5-af28-4c1f-ac93-1e9055549d06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:34.118942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d8fb5-af28-4c1f-ac93-1e9055549d06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:34.120449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d8fb5-af28-4c1f-ac93-1e9055549d06 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:34.149297 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 15/30] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:34:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:34.155862 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d8fb5-af28-4c1f-ac93-1e9055549d06 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:34.314218 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:34.370842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d8fb5-af28-4c1f-ac93-1e9055549d06 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:34.423230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9a1b7e-4c20-4f36-9359-dfa4d35f8ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:34.424279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a1b7e-4c20-4f36-9359-dfa4d35f8ef0 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:34.424745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a1b7e-4c20-4f36-9359-dfa4d35f8ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:34.425161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9a1b7e-4c20-4f36-9359-dfa4d35f8ef0 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:34.426029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a1b7e-4c20-4f36-9359-dfa4d35f8ef0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:34.426910 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0767be1-30c5-42d2-bc71-db0b6ffe87dd None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:34.427858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9a1b7e-4c20-4f36-9359-dfa4d35f8ef0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:34.489618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4750e-6f24-46db-b348-7681773ae2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:34.490685 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4750e-6f24-46db-b348-7681773ae2a1 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:34.491181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4750e-6f24-46db-b348-7681773ae2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:34.491612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4750e-6f24-46db-b348-7681773ae2a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:34.491892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:34.507610 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4750e-6f24-46db-b348-7681773ae2a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-efb4750e-6f24-46db-b348-7681773ae2a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:34.515917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:34.516893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:34:34.518327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 16/31] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:34:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:34.522679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881bca6-a5c9-4c3a-9495-51fb3c4e2bc8 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:34.522679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881bca6-a5c9-4c3a-9495-51fb3c4e2bc8 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:34.522679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1881bca6-a5c9-4c3a-9495-51fb3c4e2bc8 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:34.524837 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 17/32] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:34.533322 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881bca6-a5c9-4c3a-9495-51fb3c4e2bc8 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:34.603211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 16/33] 10.222.0.24 () {60 vars in 1141 bytes} [Sat Jun 4 20:34:34 2022] POST /identity/v3/projects => generated 301 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:34:34.605461 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb208be-dd5c-4d62-a7b9-f2e39ed5bd8c None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:34.606311 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb208be-dd5c-4d62-a7b9-f2e39ed5bd8c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:34.607330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb208be-dd5c-4d62-a7b9-f2e39ed5bd8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:34.631503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-1bb208be-dd5c-4d62-a7b9-f2e39ed5bd8c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:34.633741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-1bb208be-dd5c-4d62-a7b9-f2e39ed5bd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:34.659284 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1881bca6-a5c9-4c3a-9495-51fb3c4e2bc8 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:34.713874 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21196ac-dbc7-4fc7-ac96-da6c5a789df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:34.714650 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21196ac-dbc7-4fc7-ac96-da6c5a789df6 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:34.715001 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21196ac-dbc7-4fc7-ac96-da6c5a789df6 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:34.716120 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21196ac-dbc7-4fc7-ac96-da6c5a789df6 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:34.716803 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21196ac-dbc7-4fc7-ac96-da6c5a789df6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:34.716982 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21196ac-dbc7-4fc7-ac96-da6c5a789df6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:34.718633 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21196ac-dbc7-4fc7-ac96-da6c5a789df6 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:34.720759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:34.734679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 18/34] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:34.736219 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7144d-8668-436c-80d7-e3d053eb1cbb None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:34.736567 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7144d-8668-436c-80d7-e3d053eb1cbb None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:34.736866 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7144d-8668-436c-80d7-e3d053eb1cbb None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:34.738449 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 19/35] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:34.744695 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7144d-8668-436c-80d7-e3d053eb1cbb None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:34.782444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 17/36] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:34.790484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a442115-1a11-40ce-be60-0806174cc467 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:34.791098 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a442115-1a11-40ce-be60-0806174cc467 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:34.791648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a442115-1a11-40ce-be60-0806174cc467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:34.821839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-7a442115-1a11-40ce-be60-0806174cc467 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:34.823496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-7a442115-1a11-40ce-be60-0806174cc467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:34.874546 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7144d-8668-436c-80d7-e3d053eb1cbb None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:34.913068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 18/37] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:34.917841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a442115-1a11-40ce-be60-0806174cc467 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:34.918480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53deea-3df4-4b09-a79d-90bde71ccc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:34.919525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53deea-3df4-4b09-a79d-90bde71ccc9a None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:34.919953 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53deea-3df4-4b09-a79d-90bde71ccc9a None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:34.920388 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53deea-3df4-4b09-a79d-90bde71ccc9a None admin] PATH_INFO: `/v3/users/64937d35ffd9426ca7084e0272d22ff3` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:34.921941 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53deea-3df4-4b09-a79d-90bde71ccc9a None admin] RBAC: Authorizing `identity:get_user(user_id=64937d35ffd9426ca7084e0272d22ff3)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:34.923811 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53deea-3df4-4b09-a79d-90bde71ccc9a None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:34.925831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 20/38] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:34 2022] GET /identity/v3/users/64937d35ffd9426ca7084e0272d22ff3 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:34:34.932565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53deea-3df4-4b09-a79d-90bde71ccc9a None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:34.992999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:35.011326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:35.044654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a442115-1a11-40ce-be60-0806174cc467 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:35.054324 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53deea-3df4-4b09-a79d-90bde71ccc9a None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:35.087307 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad942a9-7a15-40f0-a8a2-b0a7d5951ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:35.088001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad942a9-7a15-40f0-a8a2-b0a7d5951ccc None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:35.088292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad942a9-7a15-40f0-a8a2-b0a7d5951ccc None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:35.088707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad942a9-7a15-40f0-a8a2-b0a7d5951ccc None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:35.089487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad942a9-7a15-40f0-a8a2-b0a7d5951ccc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:35.091211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad942a9-7a15-40f0-a8a2-b0a7d5951ccc None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:35.095585 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c700ee7-f281-4e84-9987-92f764204302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:35.096461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c700ee7-f281-4e84-9987-92f764204302 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:35.096863 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c700ee7-f281-4e84-9987-92f764204302 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:35.097200 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c700ee7-f281-4e84-9987-92f764204302 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:35.098671 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c700ee7-f281-4e84-9987-92f764204302 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:35.100387 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c700ee7-f281-4e84-9987-92f764204302 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:35.102088 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 21/39] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:34:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:35.105520 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c700ee7-f281-4e84-9987-92f764204302 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:35.109153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 19/40] 10.222.0.24 () {60 vars in 1131 bytes} [Sat Jun 4 20:34:34 2022] POST /identity/v3/roles => generated 225 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:34:35.116516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8cd26-332b-463f-8b80-b0a40aef6c2e None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:35.116516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8cd26-332b-463f-8b80-b0a40aef6c2e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:35.116516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8cd26-332b-463f-8b80-b0a40aef6c2e None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:35.116516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 20/41] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:35.116516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8cd26-332b-463f-8b80-b0a40aef6c2e None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:35.229824 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c700ee7-f281-4e84-9987-92f764204302 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:35.233948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8cd26-332b-463f-8b80-b0a40aef6c2e None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:35.256812 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:35.266892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:35.272748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f91de-ca26-4108-91f4-e02b108f0b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:35.273869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f91de-ca26-4108-91f4-e02b108f0b59 None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:35.274526 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f91de-ca26-4108-91f4-e02b108f0b59 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:35.274712 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f91de-ca26-4108-91f4-e02b108f0b59 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:35.275453 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f91de-ca26-4108-91f4-e02b108f0b59 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:35.276028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ceec8c-1140-4526-9936-9d2df3f6e742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:35.276959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceec8c-1140-4526-9936-9d2df3f6e742 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:35.277250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceec8c-1140-4526-9936-9d2df3f6e742 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:35.277340 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f91de-ca26-4108-91f4-e02b108f0b59 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:35.277597 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ceec8c-1140-4526-9936-9d2df3f6e742 None admin] PATH_INFO: `/v3/domains/default/users/64937d35ffd9426ca7084e0272d22ff3/roles/f315b062be7e445fa9461a116f9c46ee` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:35.280271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ceec8c-1140-4526-9936-9d2df3f6e742 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=64937d35ffd9426ca7084e0272d22ff3, role_id=f315b062be7e445fa9461a116f9c46ee)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:35.281649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ceec8c-1140-4526-9936-9d2df3f6e742 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:35.293963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1131 bytes} [Sat Jun 4 20:34:35 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:34:35.300682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c93c04-88da-4141-a280-e1af4c5cf0da None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:35.300682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c93c04-88da-4141-a280-e1af4c5cf0da None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:35.300682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c93c04-88da-4141-a280-e1af4c5cf0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:35.313615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 21/43] 10.222.0.24 () {58 vars in 1361 bytes} [Sat Jun 4 20:34:35 2022] PUT /identity/v3/domains/default/users/64937d35ffd9426ca7084e0272d22ff3/roles/f315b062be7e445fa9461a116f9c46ee => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:34:35.315486 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-85c93c04-88da-4141-a280-e1af4c5cf0da None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:35.317204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-85c93c04-88da-4141-a280-e1af4c5cf0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:35.410811 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 23/44] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:35.436459 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ceec8c-1140-4526-9936-9d2df3f6e742 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:35.566961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ceec8c-1140-4526-9936-9d2df3f6e742 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:35.603036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45994c1-06f7-46f8-8531-50106c5d476b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:35.603864 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45994c1-06f7-46f8-8531-50106c5d476b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:35.604223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45994c1-06f7-46f8-8531-50106c5d476b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:35.604564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45994c1-06f7-46f8-8531-50106c5d476b None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:35.606266 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45994c1-06f7-46f8-8531-50106c5d476b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:35.607826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45994c1-06f7-46f8-8531-50106c5d476b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:35.609919 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 22/45] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:34:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:35.615504 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c93c04-88da-4141-a280-e1af4c5cf0da None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:35.718950 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c93c04-88da-4141-a280-e1af4c5cf0da None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:35.744327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:35.758277 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb3dc9-512d-44da-b188-9c594cbc23d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:35.758954 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb3dc9-512d-44da-b188-9c594cbc23d7 None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:35.759248 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb3dc9-512d-44da-b188-9c594cbc23d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:35.759530 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb3dc9-512d-44da-b188-9c594cbc23d7 None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:35.760250 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb3dc9-512d-44da-b188-9c594cbc23d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:35.761784 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb3dc9-512d-44da-b188-9c594cbc23d7 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:35.790332 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 24/46] 10.222.0.24 () {60 vars in 1141 bytes} [Sat Jun 4 20:34:35 2022] POST /identity/v3/projects => generated 312 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:34:37.714000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a94b5-6649-4ace-9640-6967d65691d2 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:37.714532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a94b5-6649-4ace-9640-6967d65691d2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:37.714604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a94b5-6649-4ace-9640-6967d65691d2 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:37.716108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 23/47] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:37.722695 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3d146-a67d-4c6c-927f-758b2c2b972d None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:37.723292 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3d146-a67d-4c6c-927f-758b2c2b972d None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:37.723292 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3d146-a67d-4c6c-927f-758b2c2b972d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:37.743896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-eff3d146-a67d-4c6c-927f-758b2c2b972d None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:37.745149 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-eff3d146-a67d-4c6c-927f-758b2c2b972d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:37.837011 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 25/48] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:37.862727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a94b5-6649-4ace-9640-6967d65691d2 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:37.930858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:37.994922 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a94b5-6649-4ace-9640-6967d65691d2 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:38.032294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1c766-6702-493d-b65a-61b4b83b428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:38.033140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1c766-6702-493d-b65a-61b4b83b428e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:38.033437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1c766-6702-493d-b65a-61b4b83b428e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:38.033704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1c766-6702-493d-b65a-61b4b83b428e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:38.047652 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1c766-6702-493d-b65a-61b4b83b428e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-1db1c766-6702-493d-b65a-61b4b83b428e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:38.056664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:38.057538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:34:38.058279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 24/49] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:34:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:38.064060 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3d146-a67d-4c6c-927f-758b2c2b972d None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:38.130183 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd7f5d-0f9d-4b11-b7a3-adebb99bd0fa None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:38.130386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd7f5d-0f9d-4b11-b7a3-adebb99bd0fa None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:38.130669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd7f5d-0f9d-4b11-b7a3-adebb99bd0fa None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:38.132113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 25/50] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:34:38.137550 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae177d-250a-4e74-b636-d4dd6ebd8f24 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:38.137989 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae177d-250a-4e74-b636-d4dd6ebd8f24 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:38.138281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae177d-250a-4e74-b636-d4dd6ebd8f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:38.158926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-26ae177d-250a-4e74-b636-d4dd6ebd8f24 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:38.160306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-26ae177d-250a-4e74-b636-d4dd6ebd8f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:38.180316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3d146-a67d-4c6c-927f-758b2c2b972d None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:38.182868 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:38.224042 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11ff6-34f1-4f11-af6d-5981dff6edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:38.224768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11ff6-34f1-4f11-af6d-5981dff6edee None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:38.225060 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11ff6-34f1-4f11-af6d-5981dff6edee None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:38.225338 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea11ff6-34f1-4f11-af6d-5981dff6edee None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:38.226108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11ff6-34f1-4f11-af6d-5981dff6edee None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:38.226418 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11ff6-34f1-4f11-af6d-5981dff6edee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:38.227876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea11ff6-34f1-4f11-af6d-5981dff6edee None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:38.232742 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 26/51] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:34:38.236951 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 26/52] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:38.245091 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae177d-250a-4e74-b636-d4dd6ebd8f24 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:38.257436 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11ff6-34f1-4f11-af6d-5981dff6edee None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:38.290570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:38.353836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae177d-250a-4e74-b636-d4dd6ebd8f24 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:38.374649 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea11ff6-34f1-4f11-af6d-5981dff6edee None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:38.390169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989c185-b401-4b6e-99ea-5b2793c5aa4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:38.390998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989c185-b401-4b6e-99ea-5b2793c5aa4f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:38.391289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989c185-b401-4b6e-99ea-5b2793c5aa4f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:38.391591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989c185-b401-4b6e-99ea-5b2793c5aa4f None admin] PATH_INFO: `/v3/users/64937d35ffd9426ca7084e0272d22ff3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:38.393202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989c185-b401-4b6e-99ea-5b2793c5aa4f None admin] RBAC: Authorizing `identity:get_user(user_id=64937d35ffd9426ca7084e0272d22ff3)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:38.394701 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989c185-b401-4b6e-99ea-5b2793c5aa4f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:38.396562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 27/53] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:38 2022] GET /identity/v3/users/64937d35ffd9426ca7084e0272d22ff3 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:38.401937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989c185-b401-4b6e-99ea-5b2793c5aa4f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:38.409733 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2919b0-6d6b-4781-b08b-fff09a3a1607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:38.410546 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2919b0-6d6b-4781-b08b-fff09a3a1607 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:38.410835 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2919b0-6d6b-4781-b08b-fff09a3a1607 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:38.411120 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2919b0-6d6b-4781-b08b-fff09a3a1607 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:38.412347 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2919b0-6d6b-4781-b08b-fff09a3a1607 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:38.413836 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2919b0-6d6b-4781-b08b-fff09a3a1607 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:38.415608 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 27/54] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:34:38.421187 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2919b0-6d6b-4781-b08b-fff09a3a1607 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:38.457129 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:38.502721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989c185-b401-4b6e-99ea-5b2793c5aa4f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:38.511170 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:38.526759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2919b0-6d6b-4781-b08b-fff09a3a1607 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:38.541748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe090fb-4a93-446c-82b4-ef7130af1af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:38.542561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe090fb-4a93-446c-82b4-ef7130af1af7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:38.542853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe090fb-4a93-446c-82b4-ef7130af1af7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:38.543157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe090fb-4a93-446c-82b4-ef7130af1af7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:38.544382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe090fb-4a93-446c-82b4-ef7130af1af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:38.546853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe090fb-4a93-446c-82b4-ef7130af1af7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:38.549562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 28/55] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:34:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:38.555095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe090fb-4a93-446c-82b4-ef7130af1af7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:38.564527 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ab2916-f9a7-4d5c-bed7-9aef1e001396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:38.565247 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab2916-f9a7-4d5c-bed7-9aef1e001396 None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:38.565545 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab2916-f9a7-4d5c-bed7-9aef1e001396 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:38.565819 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ab2916-f9a7-4d5c-bed7-9aef1e001396 None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:38.566549 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab2916-f9a7-4d5c-bed7-9aef1e001396 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:38.568014 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ab2916-f9a7-4d5c-bed7-9aef1e001396 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:38.599950 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 28/56] 10.222.0.24 () {60 vars in 1140 bytes} [Sat Jun 4 20:34:38 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:34:38.683482 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe090fb-4a93-446c-82b4-ef7130af1af7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:38.726954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269073e-d883-4bef-8f55-7f7c529ef430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:38.727621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269073e-d883-4bef-8f55-7f7c529ef430 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:38.727909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269073e-d883-4bef-8f55-7f7c529ef430 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:38.728189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269073e-d883-4bef-8f55-7f7c529ef430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:38.729082 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269073e-d883-4bef-8f55-7f7c529ef430 None admin] RBAC: Adding query filter params (role.id=f315b062be7e445fa9461a116f9c46ee, scope.domain.id=default, user.id=64937d35ffd9426ca7084e0272d22ff3) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:38.729398 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269073e-d883-4bef-8f55-7f7c529ef430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:38.731184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269073e-d883-4bef-8f55-7f7c529ef430 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:38.738250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 29/57] 10.222.0.24 () {56 vars in 1322 bytes} [Sat Jun 4 20:34:38 2022] GET /identity/v3/role_assignments?user.id=64937d35ffd9426ca7084e0272d22ff3&scope.domain.id=default&role.id=f315b062be7e445fa9461a116f9c46ee => generated 530 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:40.943146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e9fa-5ba7-40d0-ae4e-dd8a9336a8dc None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:40.943664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e9fa-5ba7-40d0-ae4e-dd8a9336a8dc None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:40.943664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2e9fa-5ba7-40d0-ae4e-dd8a9336a8dc None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:40.945065 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 29/58] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:40.950708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336dfd-cf92-46b4-8540-006d912803d7 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:40.951148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336dfd-cf92-46b4-8540-006d912803d7 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:40.951230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95336dfd-cf92-46b4-8540-006d912803d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:40.969243 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-95336dfd-cf92-46b4-8540-006d912803d7 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:40.970474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-95336dfd-cf92-46b4-8540-006d912803d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:41.001894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:41.043107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 30/59] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:41.069545 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2e9fa-5ba7-40d0-ae4e-dd8a9336a8dc None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:41.163738 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:41.181902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2e9fa-5ba7-40d0-ae4e-dd8a9336a8dc None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:41.217991 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3b7011-9337-45c7-b8bd-f86bb6fccf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:41.218786 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b7011-9337-45c7-b8bd-f86bb6fccf58 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:41.219077 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b7011-9337-45c7-b8bd-f86bb6fccf58 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:41.219356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3b7011-9337-45c7-b8bd-f86bb6fccf58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:41.220631 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b7011-9337-45c7-b8bd-f86bb6fccf58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:41.222099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3b7011-9337-45c7-b8bd-f86bb6fccf58 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:41.223738 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 30/60] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:41.229592 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95336dfd-cf92-46b4-8540-006d912803d7 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:41.334164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95336dfd-cf92-46b4-8540-006d912803d7 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:41.369964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc1537-42b1-4fc0-9deb-369699c7d48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:41.370636 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc1537-42b1-4fc0-9deb-369699c7d48e None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:41.370928 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc1537-42b1-4fc0-9deb-369699c7d48e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:41.371290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc1537-42b1-4fc0-9deb-369699c7d48e None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:41.372003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc1537-42b1-4fc0-9deb-369699c7d48e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:41.373540 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc1537-42b1-4fc0-9deb-369699c7d48e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:41.403167 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 31/61] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:34:41 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:34:45.304904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99d81f-426f-48eb-bd97-de164f692b67 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:45.305489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99d81f-426f-48eb-bd97-de164f692b67 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:45.305731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99d81f-426f-48eb-bd97-de164f692b67 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:45.308217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 31/62] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:45.320246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782306-4741-4223-94ec-1e82f5c655e3 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:45.321486 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782306-4741-4223-94ec-1e82f5c655e3 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:45.322067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b782306-4741-4223-94ec-1e82f5c655e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:45.357250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-8b782306-4741-4223-94ec-1e82f5c655e3 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:45.359527 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-8b782306-4741-4223-94ec-1e82f5c655e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:45.408227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:45.530703 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 32/63] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:45.585144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99d81f-426f-48eb-bd97-de164f692b67 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:45.753945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99d81f-426f-48eb-bd97-de164f692b67 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:45.807885 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85d899-330a-494f-adca-5443af9cac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:45.808790 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85d899-330a-494f-adca-5443af9cac86 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:45.809066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85d899-330a-494f-adca-5443af9cac86 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:45.809351 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85d899-330a-494f-adca-5443af9cac86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:45.820901 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85d899-330a-494f-adca-5443af9cac86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-2a85d899-330a-494f-adca-5443af9cac86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:45.834698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:45.837406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:34:45.840491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 32/64] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:34:45.846756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782306-4741-4223-94ec-1e82f5c655e3 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:45.940069 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd345f86-7e3e-4d28-a6d0-06e64f4c4230 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:45.940529 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd345f86-7e3e-4d28-a6d0-06e64f4c4230 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:45.940761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd345f86-7e3e-4d28-a6d0-06e64f4c4230 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:45.942015 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 33/65] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:34:45.944219 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd82b0-12ac-4682-ba7b-a51d2ee19180 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:45.944532 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd82b0-12ac-4682-ba7b-a51d2ee19180 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:45.944805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd82b0-12ac-4682-ba7b-a51d2ee19180 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:45.946007 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 34/66] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:34:45.949341 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338585-feac-4860-8b81-9d99535dc533 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:45.949634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338585-feac-4860-8b81-9d99535dc533 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:45.949870 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3338585-feac-4860-8b81-9d99535dc533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:45.970609 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-b3338585-feac-4860-8b81-9d99535dc533 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:45.972093 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-b3338585-feac-4860-8b81-9d99535dc533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:45.985243 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:46.016640 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b782306-4741-4223-94ec-1e82f5c655e3 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:46.054994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e6990-d47e-4711-b18f-2f86195c6121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:46.056011 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6990-d47e-4711-b18f-2f86195c6121 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.056300 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6990-d47e-4711-b18f-2f86195c6121 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.056610 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e6990-d47e-4711-b18f-2f86195c6121 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.057460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e6990-d47e-4711-b18f-2f86195c6121 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:46.057773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e6990-d47e-4711-b18f-2f86195c6121 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:46.059314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537e6990-d47e-4711-b18f-2f86195c6121 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:46.061559 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 35/67] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:34:46.062648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7753dd-1d79-4304-b386-55da6372d748 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.062940 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7753dd-1d79-4304-b386-55da6372d748 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.063445 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7753dd-1d79-4304-b386-55da6372d748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.072656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 33/68] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:34:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:46.078382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae082a-bb3c-407b-b194-be11ad685a4b None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.078807 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae082a-bb3c-407b-b194-be11ad685a4b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.079215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae082a-bb3c-407b-b194-be11ad685a4b None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.081008 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-fe7753dd-1d79-4304-b386-55da6372d748 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:46.082069 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 34/69] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:46.082470 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-fe7753dd-1d79-4304-b386-55da6372d748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:46.083332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae082a-bb3c-407b-b194-be11ad685a4b None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:46.104746 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:46.170417 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 36/70] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:46.171280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7753dd-1d79-4304-b386-55da6372d748 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:46.213715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae082a-bb3c-407b-b194-be11ad685a4b None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:46.250779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691eb6c1-e5d9-4b6c-a007-288a05add932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:46.251914 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb6c1-e5d9-4b6c-a007-288a05add932 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.252342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb6c1-e5d9-4b6c-a007-288a05add932 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.252776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691eb6c1-e5d9-4b6c-a007-288a05add932 None admin] PATH_INFO: `/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.262267 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:46.269218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb6c1-e5d9-4b6c-a007-288a05add932 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ab45f210bf4b3e95c9f9052c7354eb)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:46.271077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691eb6c1-e5d9-4b6c-a007-288a05add932 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:46.273431 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 35/71] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:46 2022] GET /identity/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:46.275059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103c65a-83e7-4fa6-90ef-4db1d841ec19 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.275347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103c65a-83e7-4fa6-90ef-4db1d841ec19 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.275627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f103c65a-83e7-4fa6-90ef-4db1d841ec19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.294587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f103c65a-83e7-4fa6-90ef-4db1d841ec19 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:46.295841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f103c65a-83e7-4fa6-90ef-4db1d841ec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:46.304023 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7753dd-1d79-4304-b386-55da6372d748 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:46.345714 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862b744-64db-4301-9bad-e4959cd2d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:46.347313 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b744-64db-4301-9bad-e4959cd2d73a None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.347768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b744-64db-4301-9bad-e4959cd2d73a None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.348206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862b744-64db-4301-9bad-e4959cd2d73a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.362569 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862b744-64db-4301-9bad-e4959cd2d73a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-8862b744-64db-4301-9bad-e4959cd2d73a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:46.371033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:46.371995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:34:46.372793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:34:46.374830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 37/72] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:34:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:46.375842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862b744-64db-4301-9bad-e4959cd2d73a None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:46.382711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 36/73] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:46.383983 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103c65a-83e7-4fa6-90ef-4db1d841ec19 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:46.395251 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:46.490472 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862b744-64db-4301-9bad-e4959cd2d73a None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:46.492847 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f103c65a-83e7-4fa6-90ef-4db1d841ec19 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:46.528788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dea657-e07d-42f1-90de-6a8029035f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:46.529616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea657-e07d-42f1-90de-6a8029035f00 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.529911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea657-e07d-42f1-90de-6a8029035f00 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.530194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dea657-e07d-42f1-90de-6a8029035f00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.531340 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080d837e-381a-4360-bf5d-cfbad6bbd4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:46.532019 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d837e-381a-4360-bf5d-cfbad6bbd4a0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.532214 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:46.532310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d837e-381a-4360-bf5d-cfbad6bbd4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.532601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080d837e-381a-4360-bf5d-cfbad6bbd4a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.542321 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dea657-e07d-42f1-90de-6a8029035f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-82dea657-e07d-42f1-90de-6a8029035f00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:46.550181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:46.551027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:34:46.552081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 38/74] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:34:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:46.553230 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dea657-e07d-42f1-90de-6a8029035f00 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:46.608541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d837e-381a-4360-bf5d-cfbad6bbd4a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:46.610148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080d837e-381a-4360-bf5d-cfbad6bbd4a0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:46.613189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:46.656938 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dea657-e07d-42f1-90de-6a8029035f00 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:46.700669 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78528e5c-c720-4618-a719-51c44c25e977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:46.701350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78528e5c-c720-4618-a719-51c44c25e977 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.701637 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78528e5c-c720-4618-a719-51c44c25e977 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.701917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78528e5c-c720-4618-a719-51c44c25e977 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.702670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78528e5c-c720-4618-a719-51c44c25e977 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:46.702979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78528e5c-c720-4618-a719-51c44c25e977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:46.704375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78528e5c-c720-4618-a719-51c44c25e977 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:46.712615 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 39/75] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:34:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:46.713427 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78528e5c-c720-4618-a719-51c44c25e977 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:46.717273 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 37/76] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:34:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:34:46.718695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a180c-c259-4707-9234-9e89dcf6b7d6 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.719055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a180c-c259-4707-9234-9e89dcf6b7d6 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.719350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a180c-c259-4707-9234-9e89dcf6b7d6 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.720897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 38/77] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:46.721509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a180c-c259-4707-9234-9e89dcf6b7d6 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:46.774251 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:46.820965 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78528e5c-c720-4618-a719-51c44c25e977 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:46.833098 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a180c-c259-4707-9234-9e89dcf6b7d6 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:46.836192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:46.862012 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a80b-d928-47d9-b575-a9355c38e3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:46.862824 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a80b-d928-47d9-b575-a9355c38e3e4 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.863114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a80b-d928-47d9-b575-a9355c38e3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.863449 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1a80b-d928-47d9-b575-a9355c38e3e4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.872932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3722d6-787f-4c57-9159-ebe1c3a33714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:46.873619 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3722d6-787f-4c57-9159-ebe1c3a33714 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:46.873908 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3722d6-787f-4c57-9159-ebe1c3a33714 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:46.874051 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1a80b-d928-47d9-b575-a9355c38e3e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:46.874189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3722d6-787f-4c57-9159-ebe1c3a33714 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:46.874951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3722d6-787f-4c57-9159-ebe1c3a33714 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:46.875261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3722d6-787f-4c57-9159-ebe1c3a33714 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:46.876709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3722d6-787f-4c57-9159-ebe1c3a33714 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-b9a1a80b-d928-47d9-b575-a9355c38e3e4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:46.881815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:46.882842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:34:46.883604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 40/78] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:46.884200 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a80b-d928-47d9-b575-a9355c38e3e4 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:46.888201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 39/79] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:46.889113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3722d6-787f-4c57-9159-ebe1c3a33714 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:46.990971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3722d6-787f-4c57-9159-ebe1c3a33714 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:46.992563 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1a80b-d928-47d9-b575-a9355c38e3e4 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:47.009814 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:47.026764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf9fb0-5296-4cb6-8d34-ac61a25b35c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:47.027885 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf9fb0-5296-4cb6-8d34-ac61a25b35c5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:47.028157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf9fb0-5296-4cb6-8d34-ac61a25b35c5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:47.028476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf9fb0-5296-4cb6-8d34-ac61a25b35c5 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:47.029681 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f018620-03a5-461c-a029-bec3d73ac969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:47.029826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf9fb0-5296-4cb6-8d34-ac61a25b35c5 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:47.030567 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f018620-03a5-461c-a029-bec3d73ac969 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:47.030859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f018620-03a5-461c-a029-bec3d73ac969 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:47.031135 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f018620-03a5-461c-a029-bec3d73ac969 None admin] PATH_INFO: `/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:47.031264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbf9fb0-5296-4cb6-8d34-ac61a25b35c5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:47.032406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f018620-03a5-461c-a029-bec3d73ac969 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ab45f210bf4b3e95c9f9052c7354eb)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:47.032947 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 40/80] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:34:46 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:47.033901 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f018620-03a5-461c-a029-bec3d73ac969 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:47.034112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce103e-1256-4d6f-8d38-e0101296e9b5 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:47.034372 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce103e-1256-4d6f-8d38-e0101296e9b5 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:47.034654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce103e-1256-4d6f-8d38-e0101296e9b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:47.040196 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 41/81] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:46 2022] GET /identity/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:47.040196 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f018620-03a5-461c-a029-bec3d73ac969 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:47.055833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-99ce103e-1256-4d6f-8d38-e0101296e9b5 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:47.057116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-99ce103e-1256-4d6f-8d38-e0101296e9b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:47.088237 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:47.130187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 41/82] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:47.130955 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce103e-1256-4d6f-8d38-e0101296e9b5 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:47.158949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f018620-03a5-461c-a029-bec3d73ac969 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:47.193923 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72608f-6a4d-4a1a-9707-3a52fc662761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:47.194596 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72608f-6a4d-4a1a-9707-3a52fc662761 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:47.194880 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72608f-6a4d-4a1a-9707-3a52fc662761 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:47.195157 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72608f-6a4d-4a1a-9707-3a52fc662761 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:47.195909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72608f-6a4d-4a1a-9707-3a52fc662761 None admin] RBAC: Adding query filter params (name=member) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:47.196215 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72608f-6a4d-4a1a-9707-3a52fc662761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:47.197658 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72608f-6a4d-4a1a-9707-3a52fc662761 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:47.206567 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 42/83] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:34:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:47.212076 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72608f-6a4d-4a1a-9707-3a52fc662761 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:47.238611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce103e-1256-4d6f-8d38-e0101296e9b5 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:47.260656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:47.276455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbeb0a-b9d2-4854-9564-469b76048498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:47.277593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbeb0a-b9d2-4854-9564-469b76048498 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:47.277868 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbeb0a-b9d2-4854-9564-469b76048498 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:47.278157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbeb0a-b9d2-4854-9564-469b76048498 None admin] PATH_INFO: `/v3/users/64937d35ffd9426ca7084e0272d22ff3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:47.279408 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbeb0a-b9d2-4854-9564-469b76048498 None admin] RBAC: Authorizing `identity:get_user(user_id=64937d35ffd9426ca7084e0272d22ff3)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:47.280933 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbeb0a-b9d2-4854-9564-469b76048498 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:47.282593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 42/84] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:47 2022] GET /identity/v3/users/64937d35ffd9426ca7084e0272d22ff3 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:47.283359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbeb0a-b9d2-4854-9564-469b76048498 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:47.315473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:47.320816 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72608f-6a4d-4a1a-9707-3a52fc662761 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:47.355996 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7714058-37ce-4813-a745-44a707d030ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:47.356695 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714058-37ce-4813-a745-44a707d030ad None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:47.356971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714058-37ce-4813-a745-44a707d030ad None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:47.357254 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7714058-37ce-4813-a745-44a707d030ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:47.358202 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7714058-37ce-4813-a745-44a707d030ad None admin] RBAC: Adding query filter params (role.id=52b41e61eb19402aa67a7defc45d7f5f, scope.project.id=2614591ccb4e488ba922d8212cdc54ee, user.id=d2ab45f210bf4b3e95c9f9052c7354eb) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:47.358525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7714058-37ce-4813-a745-44a707d030ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:47.360023 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7714058-37ce-4813-a745-44a707d030ad None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:47.369540 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 43/85] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:34:47 2022] GET /identity/v3/role_assignments?user.id=d2ab45f210bf4b3e95c9f9052c7354eb&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:47.370394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7714058-37ce-4813-a745-44a707d030ad None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:47.387787 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbeb0a-b9d2-4854-9564-469b76048498 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:47.431839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8bd0-0e5b-4144-8f0b-d9c7c1c04000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:47.432565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8bd0-0e5b-4144-8f0b-d9c7c1c04000 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:47.432897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8bd0-0e5b-4144-8f0b-d9c7c1c04000 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:47.433323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0e8bd0-0e5b-4144-8f0b-d9c7c1c04000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:47.513965 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7714058-37ce-4813-a745-44a707d030ad None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:47.515379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e8bd0-0e5b-4144-8f0b-d9c7c1c04000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:47.519515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0e8bd0-0e5b-4144-8f0b-d9c7c1c04000 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:47.530037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:47.557320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:47.559872 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a1356-a509-4d7f-bd09-6a210c16f74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:47.560974 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1356-a509-4d7f-bd09-6a210c16f74a None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:47.561259 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1356-a509-4d7f-bd09-6a210c16f74a None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:47.561533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a1356-a509-4d7f-bd09-6a210c16f74a None admin] PATH_INFO: `/v3/domains/default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:47.562823 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a1356-a509-4d7f-bd09-6a210c16f74a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:47.564332 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779a1356-a509-4d7f-bd09-6a210c16f74a None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:47.566314 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 44/86] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:34:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:47.566957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a1356-a509-4d7f-bd09-6a210c16f74a None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:47.658085 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 43/87] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:34:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:34:47.661544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8bd0-0e5b-4144-8f0b-d9c7c1c04000 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:47.700256 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a1356-a509-4d7f-bd09-6a210c16f74a None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:47.744319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e52f26-6d66-4ab2-b249-ba746aecbda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:47.745237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52f26-6d66-4ab2-b249-ba746aecbda0 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:47.745536 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52f26-6d66-4ab2-b249-ba746aecbda0 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:47.745997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e52f26-6d66-4ab2-b249-ba746aecbda0 None admin] PATH_INFO: `/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:47.747317 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e52f26-6d66-4ab2-b249-ba746aecbda0 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ab45f210bf4b3e95c9f9052c7354eb)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:47.748923 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e52f26-6d66-4ab2-b249-ba746aecbda0 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:47.750642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 45/88] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:47 2022] GET /identity/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:47.751925 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e52f26-6d66-4ab2-b249-ba746aecbda0 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:47.787008 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0e8bd0-0e5b-4144-8f0b-d9c7c1c04000 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:47.803813 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:47.819488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:47.825842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79cda4-41cb-4fa5-8074-a92488bc4c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:47.826532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79cda4-41cb-4fa5-8074-a92488bc4c93 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:47.826859 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79cda4-41cb-4fa5-8074-a92488bc4c93 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:47.827172 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd79cda4-41cb-4fa5-8074-a92488bc4c93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:47.869945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e52f26-6d66-4ab2-b249-ba746aecbda0 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:47.905432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79cda4-41cb-4fa5-8074-a92488bc4c93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:47.907215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd79cda4-41cb-4fa5-8074-a92488bc4c93 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:47.908329 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb79f7-bb03-47a7-804b-215e0fdf9713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:47.908984 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb79f7-bb03-47a7-804b-215e0fdf9713 None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:47.909380 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb79f7-bb03-47a7-804b-215e0fdf9713 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:47.909703 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb79f7-bb03-47a7-804b-215e0fdf9713 None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:47.911206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb79f7-bb03-47a7-804b-215e0fdf9713 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:47.911948 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb79f7-bb03-47a7-804b-215e0fdf9713 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:47.952466 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 46/89] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:34:47 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:34:47.952466 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb79f7-bb03-47a7-804b-215e0fdf9713 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:48.056257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 44/90] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:34:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:34:48.057355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79cda4-41cb-4fa5-8074-a92488bc4c93 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:48.078811 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb79f7-bb03-47a7-804b-215e0fdf9713 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:48.080992 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:48.100701 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:48.126605 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dcbb1-a55e-44e5-866d-cbac29dc41a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:48.127609 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dcbb1-a55e-44e5-866d-cbac29dc41a4 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:48.127972 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dcbb1-a55e-44e5-866d-cbac29dc41a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:48.128314 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510dcbb1-a55e-44e5-866d-cbac29dc41a4 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:48.129952 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dcbb1-a55e-44e5-866d-cbac29dc41a4 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:48.131695 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510dcbb1-a55e-44e5-866d-cbac29dc41a4 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:48.133853 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 47/91] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:34:47 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:48.134875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dcbb1-a55e-44e5-866d-cbac29dc41a4 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:48.208950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd79cda4-41cb-4fa5-8074-a92488bc4c93 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:48.251218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e13f6e-c496-4502-af99-41f8a2a980fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:48.251918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e13f6e-c496-4502-af99-41f8a2a980fa None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:48.252215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e13f6e-c496-4502-af99-41f8a2a980fa None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:48.252537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e13f6e-c496-4502-af99-41f8a2a980fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:48.273125 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510dcbb1-a55e-44e5-866d-cbac29dc41a4 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:48.325397 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44545c6-b0a8-49ca-bf9a-cda41ebf6d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:48.326299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44545c6-b0a8-49ca-bf9a-cda41ebf6d35 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:48.326562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44545c6-b0a8-49ca-bf9a-cda41ebf6d35 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:48.326836 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44545c6-b0a8-49ca-bf9a-cda41ebf6d35 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:48.328753 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44545c6-b0a8-49ca-bf9a-cda41ebf6d35 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:48.330229 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44545c6-b0a8-49ca-bf9a-cda41ebf6d35 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:48.331974 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 48/92] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:34:48 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:48.332795 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44545c6-b0a8-49ca-bf9a-cda41ebf6d35 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:48.344201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e13f6e-c496-4502-af99-41f8a2a980fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:48.346070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e13f6e-c496-4502-af99-41f8a2a980fa None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:48.384700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:48.394258 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:48.477562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 45/93] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:34:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:34:48.478270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e13f6e-c496-4502-af99-41f8a2a980fa None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:48.481435 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44545c6-b0a8-49ca-bf9a-cda41ebf6d35 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:48.529060 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e6f66-765e-42a7-94a0-2a20d1b7eba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:48.529816 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e6f66-765e-42a7-94a0-2a20d1b7eba8 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:48.530170 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e6f66-765e-42a7-94a0-2a20d1b7eba8 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:48.530515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e6f66-765e-42a7-94a0-2a20d1b7eba8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:48.531453 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e6f66-765e-42a7-94a0-2a20d1b7eba8 None admin] RBAC: Adding query filter params (role.id=293f9e8d2aba452aadef740529c3d498, scope.project.id=2614591ccb4e488ba922d8212cdc54ee, user.id=d2ab45f210bf4b3e95c9f9052c7354eb) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:48.531836 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e6f66-765e-42a7-94a0-2a20d1b7eba8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:48.533547 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6e6f66-765e-42a7-94a0-2a20d1b7eba8 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:48.539872 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 49/94] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:34:48 2022] GET /identity/v3/role_assignments?user.id=d2ab45f210bf4b3e95c9f9052c7354eb&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=293f9e8d2aba452aadef740529c3d498 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:48.540670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e6f66-765e-42a7-94a0-2a20d1b7eba8 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:48.790549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e13f6e-c496-4502-af99-41f8a2a980fa None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:48.806554 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e6f66-765e-42a7-94a0-2a20d1b7eba8 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:48.808077 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:48.850724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:48.862125 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d66cc1-f070-44b9-a754-a1d6a7751528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:48.863191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66cc1-f070-44b9-a754-a1d6a7751528 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:48.863685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66cc1-f070-44b9-a754-a1d6a7751528 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:48.864146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66cc1-f070-44b9-a754-a1d6a7751528 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:48.865791 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d66cc1-f070-44b9-a754-a1d6a7751528 None admin] RBAC: Adding query filter params (role.id=f315b062be7e445fa9461a116f9c46ee, scope.project.id=2614591ccb4e488ba922d8212cdc54ee, user.id=64937d35ffd9426ca7084e0272d22ff3) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:48.866306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d66cc1-f070-44b9-a754-a1d6a7751528 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:48.867990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d66cc1-f070-44b9-a754-a1d6a7751528 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:48.883237 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 46/95] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:34:48 2022] GET /identity/v3/role_assignments?user.id=64937d35ffd9426ca7084e0272d22ff3&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=f315b062be7e445fa9461a116f9c46ee => generated 259 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:48.905787 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97715b1-d287-42ae-8f6d-f828d6a82ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:48.906768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97715b1-d287-42ae-8f6d-f828d6a82ef2 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:48.907063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97715b1-d287-42ae-8f6d-f828d6a82ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:48.907405 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97715b1-d287-42ae-8f6d-f828d6a82ef2 None admin] PATH_INFO: `/v3/projects/ea05dad56d304d4d8bd86333624f0c10` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:48.908674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97715b1-d287-42ae-8f6d-f828d6a82ef2 None admin] RBAC: Authorizing `identity:get_project(project_id=ea05dad56d304d4d8bd86333624f0c10)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:48.910167 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97715b1-d287-42ae-8f6d-f828d6a82ef2 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:48.911953 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 50/96] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:34:48 2022] GET /identity/v3/projects/ea05dad56d304d4d8bd86333624f0c10 => generated 312 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:48.918264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d66cc1-f070-44b9-a754-a1d6a7751528 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:49.045967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d66cc1-f070-44b9-a754-a1d6a7751528 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:49.085587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc886011-b23b-4e07-866c-6915857eb931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:49.086619 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886011-b23b-4e07-866c-6915857eb931 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:49.087088 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886011-b23b-4e07-866c-6915857eb931 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:49.087523 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc886011-b23b-4e07-866c-6915857eb931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:49.088564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc886011-b23b-4e07-866c-6915857eb931 None admin] RBAC: Adding query filter params (role.id=52b41e61eb19402aa67a7defc45d7f5f, scope.project.id=ea05dad56d304d4d8bd86333624f0c10, user.id=d2ab45f210bf4b3e95c9f9052c7354eb) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:49.089056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc886011-b23b-4e07-866c-6915857eb931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:49.090812 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc886011-b23b-4e07-866c-6915857eb931 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:49.097695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 47/97] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:34:48 2022] GET /identity/v3/role_assignments?user.id=d2ab45f210bf4b3e95c9f9052c7354eb&scope.project.id=ea05dad56d304d4d8bd86333624f0c10&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:50.886372 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d11816-32f8-429c-92a2-17f7dcd5200c None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:50.886372 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d11816-32f8-429c-92a2-17f7dcd5200c None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:50.886372 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d11816-32f8-429c-92a2-17f7dcd5200c None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:50.887451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 51/98] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:50.898359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509396-f508-4c69-827f-f729300875d6 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:50.899325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509396-f508-4c69-827f-f729300875d6 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:50.899819 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86509396-f508-4c69-827f-f729300875d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:50.929752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-86509396-f508-4c69-827f-f729300875d6 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:50.931413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-86509396-f508-4c69-827f-f729300875d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:51.009548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:51.023840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 48/99] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:51.061526 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d11816-32f8-429c-92a2-17f7dcd5200c None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:51.210010 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d11816-32f8-429c-92a2-17f7dcd5200c None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:51.259882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbb4afc-0670-4b26-ae25-0ca335279b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:51.260740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb4afc-0670-4b26-ae25-0ca335279b80 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:51.261063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb4afc-0670-4b26-ae25-0ca335279b80 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:51.261352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbb4afc-0670-4b26-ae25-0ca335279b80 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:51.281429 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbb4afc-0670-4b26-ae25-0ca335279b80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-adbb4afc-0670-4b26-ae25-0ca335279b80 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:51.289783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:51.290884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:34:51.291670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 52/100] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:51.299194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86509396-f508-4c69-827f-f729300875d6 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:51.454537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86509396-f508-4c69-827f-f729300875d6 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:51.472099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b7b79-9619-4516-974d-226de913434a None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:51.472391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b7b79-9619-4516-974d-226de913434a None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:51.472795 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b7b79-9619-4516-974d-226de913434a None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:51.474563 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 53/101] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:51.493999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436a278-0608-493c-bee2-d06ee8ce5a5b None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:51.494445 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436a278-0608-493c-bee2-d06ee8ce5a5b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:51.494832 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2436a278-0608-493c-bee2-d06ee8ce5a5b None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:51.496857 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 54/102] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:51.500966 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee553872-2f8e-4123-9a33-e4e4442e2142 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:51.502030 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee553872-2f8e-4123-9a33-e4e4442e2142 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:51.502332 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee553872-2f8e-4123-9a33-e4e4442e2142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:51.513782 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da497fcb-4877-49e4-a957-2cec458d104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:51.514537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da497fcb-4877-49e4-a957-2cec458d104b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:51.514828 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da497fcb-4877-49e4-a957-2cec458d104b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:51.515110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da497fcb-4877-49e4-a957-2cec458d104b None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:51.515907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da497fcb-4877-49e4-a957-2cec458d104b None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:51.520871 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da497fcb-4877-49e4-a957-2cec458d104b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:51.522806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da497fcb-4877-49e4-a957-2cec458d104b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:51.534806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 49/103] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:34:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:51.536275 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1f339-dade-4200-8e75-1e9589177a2a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:51.541002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1f339-dade-4200-8e75-1e9589177a2a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:51.542347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1f339-dade-4200-8e75-1e9589177a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:51.558028 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-ee553872-2f8e-4123-9a33-e4e4442e2142 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:51.559511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-ee553872-2f8e-4123-9a33-e4e4442e2142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:51.563617 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c1f1f339-dade-4200-8e75-1e9589177a2a None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:51.565027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c1f1f339-dade-4200-8e75-1e9589177a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:51.618491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:51.655143 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:51.694293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 50/104] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:51.695451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1f339-dade-4200-8e75-1e9589177a2a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:51.706724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 55/105] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:34:51.749917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee553872-2f8e-4123-9a33-e4e4442e2142 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:51.844206 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f1f339-dade-4200-8e75-1e9589177a2a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:51.884387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7ceb8-db2e-4ff1-8ff7-7f672618eded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:51.885786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ceb8-db2e-4ff1-8ff7-7f672618eded None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:51.886262 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ceb8-db2e-4ff1-8ff7-7f672618eded None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:51.886787 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ceb8-db2e-4ff1-8ff7-7f672618eded None admin] PATH_INFO: `/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:51.888312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7ceb8-db2e-4ff1-8ff7-7f672618eded None admin] RBAC: Authorizing `identity:get_user(user_id=d2ab45f210bf4b3e95c9f9052c7354eb)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:51.890192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd7ceb8-db2e-4ff1-8ff7-7f672618eded None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:51.892671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 51/106] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:51 2022] GET /identity/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:51.893804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7ceb8-db2e-4ff1-8ff7-7f672618eded None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:51.947124 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee553872-2f8e-4123-9a33-e4e4442e2142 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:51.989234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:51.990235 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1b431-b197-4ee4-b5bd-99910e0bce4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:51.991116 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1b431-b197-4ee4-b5bd-99910e0bce4e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:51.991382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1b431-b197-4ee4-b5bd-99910e0bce4e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:51.991663 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1b431-b197-4ee4-b5bd-99910e0bce4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:51.992951 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1b431-b197-4ee4-b5bd-99910e0bce4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:51.994598 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1b431-b197-4ee4-b5bd-99910e0bce4e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:51.996167 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 56/107] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:34:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:52.002138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c8175-f9a2-4bc9-b0c3-d50b710eb879 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.002138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c8175-f9a2-4bc9-b0c3-d50b710eb879 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.002138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c8175-f9a2-4bc9-b0c3-d50b710eb879 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.002138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 57/108] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:52.002138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c8175-f9a2-4bc9-b0c3-d50b710eb879 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:52.037207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:52.039486 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd7ceb8-db2e-4ff1-8ff7-7f672618eded None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:52.078727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed661d-a964-4223-8a8e-ea0bdf88a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:52.079609 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed661d-a964-4223-8a8e-ea0bdf88a706 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.080237 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed661d-a964-4223-8a8e-ea0bdf88a706 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.080237 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ed661d-a964-4223-8a8e-ea0bdf88a706 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.093354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ed661d-a964-4223-8a8e-ea0bdf88a706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-59ed661d-a964-4223-8a8e-ea0bdf88a706 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:52.101455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:52.102615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:34:52.103557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 52/109] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:52.104223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed661d-a964-4223-8a8e-ea0bdf88a706 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:52.128983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c8175-f9a2-4bc9-b0c3-d50b710eb879 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:52.166976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4776adb-8c55-4d38-bc28-508f4bf10aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:52.168394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776adb-8c55-4d38-bc28-508f4bf10aef None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.168850 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776adb-8c55-4d38-bc28-508f4bf10aef None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.169287 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4776adb-8c55-4d38-bc28-508f4bf10aef None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.170686 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4776adb-8c55-4d38-bc28-508f4bf10aef None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:52.172351 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4776adb-8c55-4d38-bc28-508f4bf10aef None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:52.174628 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 58/110] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:34:51 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:52.176086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d2ff5-bcc2-4dec-aaed-4b65cd9482f7 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.176566 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d2ff5-bcc2-4dec-aaed-4b65cd9482f7 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.177000 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d2ff5-bcc2-4dec-aaed-4b65cd9482f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.194705 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-ee7d2ff5-bcc2-4dec-aaed-4b65cd9482f7 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:52.196350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-ee7d2ff5-bcc2-4dec-aaed-4b65cd9482f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:52.215764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ed661d-a964-4223-8a8e-ea0bdf88a706 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:52.227068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:52.255462 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffa26b-30f5-40a0-af2e-9064d6b50cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:52.256469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa26b-30f5-40a0-af2e-9064d6b50cdf None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.257028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa26b-30f5-40a0-af2e-9064d6b50cdf None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.257504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa26b-30f5-40a0-af2e-9064d6b50cdf None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.258418 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffa26b-30f5-40a0-af2e-9064d6b50cdf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:52.260242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffa26b-30f5-40a0-af2e-9064d6b50cdf None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:52.273713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 59/111] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:52.274929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d2ff5-bcc2-4dec-aaed-4b65cd9482f7 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:52.304023 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:52.318418 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 53/112] 10.222.0.24 () {60 vars in 1141 bytes} [Sat Jun 4 20:34:52 2022] POST /identity/v3/projects => generated 302 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:34:52.319680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffa26b-30f5-40a0-af2e-9064d6b50cdf None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:52.442637 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffa26b-30f5-40a0-af2e-9064d6b50cdf None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:52.457682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d2ff5-bcc2-4dec-aaed-4b65cd9482f7 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:52.487992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97fc4-0ac6-4884-a855-bfe52e4bde54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:52.489331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97fc4-0ac6-4884-a855-bfe52e4bde54 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.489757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97fc4-0ac6-4884-a855-bfe52e4bde54 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.490342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff97fc4-0ac6-4884-a855-bfe52e4bde54 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee/users/d2ab45f210bf4b3e95c9f9052c7354eb/roles/52b41e61eb19402aa67a7defc45d7f5f` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.493361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97fc4-0ac6-4884-a855-bfe52e4bde54 None admin] RBAC: Authorizing `identity:create_grant(project_id=2614591ccb4e488ba922d8212cdc54ee, user_id=d2ab45f210bf4b3e95c9f9052c7354eb, role_id=52b41e61eb19402aa67a7defc45d7f5f)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:52.495168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff97fc4-0ac6-4884-a855-bfe52e4bde54 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:52.527533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 54/113] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:34:52 2022] PUT /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee/users/d2ab45f210bf4b3e95c9f9052c7354eb/roles/52b41e61eb19402aa67a7defc45d7f5f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:34:52.531466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97fc4-0ac6-4884-a855-bfe52e4bde54 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:52.551656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e1a52-dee4-4c64-86b0-bf17498fa204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:52.552756 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1a52-dee4-4c64-86b0-bf17498fa204 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.554084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1a52-dee4-4c64-86b0-bf17498fa204 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.554529 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e1a52-dee4-4c64-86b0-bf17498fa204 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.558397 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e1a52-dee4-4c64-86b0-bf17498fa204 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:52.559084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e1a52-dee4-4c64-86b0-bf17498fa204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:52.562605 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e1a52-dee4-4c64-86b0-bf17498fa204 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:52.588466 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 60/114] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:34:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:52.593574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:52.597170 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e1a52-dee4-4c64-86b0-bf17498fa204 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:52.705655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff97fc4-0ac6-4884-a855-bfe52e4bde54 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:52.733506 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:52.753068 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e1a52-dee4-4c64-86b0-bf17498fa204 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:52.753561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5a34d-d202-4e99-a4ed-68be9c8a5d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:52.754679 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5a34d-d202-4e99-a4ed-68be9c8a5d4a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.755473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5a34d-d202-4e99-a4ed-68be9c8a5d4a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.756074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5a34d-d202-4e99-a4ed-68be9c8a5d4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.776191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5a34d-d202-4e99-a4ed-68be9c8a5d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-e3e5a34d-d202-4e99-a4ed-68be9c8a5d4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:52.785232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:52.786287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 55/115] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:34:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:52.791328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f492e24-745c-4fc3-ad38-f0a154837bc1 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.792028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f492e24-745c-4fc3-ad38-f0a154837bc1 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.792028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f492e24-745c-4fc3-ad38-f0a154837bc1 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.792028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 56/116] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:52.792028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5979905-d6e2-46fe-9782-d61baecdcc5c None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.792305 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5979905-d6e2-46fe-9782-d61baecdcc5c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.792369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5979905-d6e2-46fe-9782-d61baecdcc5c None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.798451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 57/117] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:52.799232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5979905-d6e2-46fe-9782-d61baecdcc5c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:52.810335 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9121d-f67d-42b3-b4f3-6ae0a51f81bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:52.811357 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9121d-f67d-42b3-b4f3-6ae0a51f81bf None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.811710 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9121d-f67d-42b3-b4f3-6ae0a51f81bf None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.812055 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9121d-f67d-42b3-b4f3-6ae0a51f81bf None admin] PATH_INFO: `/v3/users/bcf87e6e0dbc4c99a65ef1cf4c43f4ac` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.838976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9121d-f67d-42b3-b4f3-6ae0a51f81bf None admin] RBAC: Authorizing `identity:get_user(user_id=bcf87e6e0dbc4c99a65ef1cf4c43f4ac)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:52.838976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9121d-f67d-42b3-b4f3-6ae0a51f81bf None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:52.840663 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 61/118] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:52 2022] GET /identity/v3/users/bcf87e6e0dbc4c99a65ef1cf4c43f4ac => generated 289 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:52.843967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5445-5876-40af-8313-95716ec2fa19 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.843967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5445-5876-40af-8313-95716ec2fa19 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.843967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f5445-5876-40af-8313-95716ec2fa19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.862636 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-ea1f5445-5876-40af-8313-95716ec2fa19 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:52.863881 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-ea1f5445-5876-40af-8313-95716ec2fa19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:52.918829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:52.946837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5979905-d6e2-46fe-9782-d61baecdcc5c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:52.953784 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 62/119] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:52.955195 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a273f-0fe4-427f-9e78-9826b7ef6070 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:52.955536 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a273f-0fe4-427f-9e78-9826b7ef6070 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:52.956591 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2a273f-0fe4-427f-9e78-9826b7ef6070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:52.975616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-ac2a273f-0fe4-427f-9e78-9826b7ef6070 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:52.976885 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-ac2a273f-0fe4-427f-9e78-9826b7ef6070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:53.011191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fcef6-9f95-4db4-bbd6-acb2d4e6b4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:53.012773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fcef6-9f95-4db4-bbd6-acb2d4e6b4b1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:53.013067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fcef6-9f95-4db4-bbd6-acb2d4e6b4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:53.013351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fcef6-9f95-4db4-bbd6-acb2d4e6b4b1 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:53.014182 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fcef6-9f95-4db4-bbd6-acb2d4e6b4b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:53.014494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fcef6-9f95-4db4-bbd6-acb2d4e6b4b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:53.016056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fcef6-9f95-4db4-bbd6-acb2d4e6b4b1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:53.025536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 58/120] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:34:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:53.026176 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fcef6-9f95-4db4-bbd6-acb2d4e6b4b1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:53.073202 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 63/121] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:53.074385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a273f-0fe4-427f-9e78-9826b7ef6070 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:53.085405 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:53.175613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fcef6-9f95-4db4-bbd6-acb2d4e6b4b1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:53.200120 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2a273f-0fe4-427f-9e78-9826b7ef6070 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:53.224001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81b9fe-48ad-4b7e-b55b-6a57fd20778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:53.224916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81b9fe-48ad-4b7e-b55b-6a57fd20778b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:53.225211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81b9fe-48ad-4b7e-b55b-6a57fd20778b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:53.225518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81b9fe-48ad-4b7e-b55b-6a57fd20778b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:53.238497 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14fed-bd6d-4d94-814f-f8c200073ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:53.239605 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14fed-bd6d-4d94-814f-f8c200073ffb None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:53.240035 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14fed-bd6d-4d94-814f-f8c200073ffb None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:53.240489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef14fed-bd6d-4d94-814f-f8c200073ffb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:53.246608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:53.255707 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef14fed-bd6d-4d94-814f-f8c200073ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-fef14fed-bd6d-4d94-814f-f8c200073ffb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:53.264632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:53.265765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:53.266541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:34:53.268859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 64/122] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:53.270176 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14fed-bd6d-4d94-814f-f8c200073ffb None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:53.317131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81b9fe-48ad-4b7e-b55b-6a57fd20778b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:53.319019 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81b9fe-48ad-4b7e-b55b-6a57fd20778b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:53.357902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:53.398367 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef14fed-bd6d-4d94-814f-f8c200073ffb None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:53.430255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 59/123] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:34:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:34:53.431449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81b9fe-48ad-4b7e-b55b-6a57fd20778b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:53.441088 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a71008-6edf-41bd-834c-aecd073e1d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:53.441994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a71008-6edf-41bd-834c-aecd073e1d44 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:53.442286 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a71008-6edf-41bd-834c-aecd073e1d44 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:53.442566 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a71008-6edf-41bd-834c-aecd073e1d44 None admin] PATH_INFO: `/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:53.443804 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a71008-6edf-41bd-834c-aecd073e1d44 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ab45f210bf4b3e95c9f9052c7354eb)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:53.445372 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a71008-6edf-41bd-834c-aecd073e1d44 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:53.447236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 65/124] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:53 2022] GET /identity/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:53.447902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a71008-6edf-41bd-834c-aecd073e1d44 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:53.483378 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:53.554916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81b9fe-48ad-4b7e-b55b-6a57fd20778b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:53.559230 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a71008-6edf-41bd-834c-aecd073e1d44 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:53.591864 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955fdf2-7b38-4c3e-9a9b-315a0e525cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:53.593040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955fdf2-7b38-4c3e-9a9b-315a0e525cb1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:53.593615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955fdf2-7b38-4c3e-9a9b-315a0e525cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:53.594067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955fdf2-7b38-4c3e-9a9b-315a0e525cb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:53.595840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06c764-7f62-4616-b406-8dbe82df6808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:53.596546 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06c764-7f62-4616-b406-8dbe82df6808 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:53.596837 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06c764-7f62-4616-b406-8dbe82df6808 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:53.597119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06c764-7f62-4616-b406-8dbe82df6808 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:53.598011 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06c764-7f62-4616-b406-8dbe82df6808 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:53.598188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06c764-7f62-4616-b406-8dbe82df6808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:53.599587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06c764-7f62-4616-b406-8dbe82df6808 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:53.600968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:53.607444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955fdf2-7b38-4c3e-9a9b-315a0e525cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:53.611805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 66/125] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:53.613201 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06c764-7f62-4616-b406-8dbe82df6808 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-b955fdf2-7b38-4c3e-9a9b-315a0e525cb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:53.616385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:53.617350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:34:53.618099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 60/126] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:53.625357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955fdf2-7b38-4c3e-9a9b-315a0e525cb1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:53.749189 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06c764-7f62-4616-b406-8dbe82df6808 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:53.771253 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955fdf2-7b38-4c3e-9a9b-315a0e525cb1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:53.774828 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:53.804626 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44cdbe-dc12-4225-99e9-11cbb6675e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:53.805602 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44cdbe-dc12-4225-99e9-11cbb6675e19 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:53.805904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44cdbe-dc12-4225-99e9-11cbb6675e19 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:53.806187 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44cdbe-dc12-4225-99e9-11cbb6675e19 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:53.808053 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44cdbe-dc12-4225-99e9-11cbb6675e19 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:53.809988 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c44cdbe-dc12-4225-99e9-11cbb6675e19 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:53.817647 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 67/127] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:34:53 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:53.817647 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44cdbe-dc12-4225-99e9-11cbb6675e19 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:53.828005 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b1abd-c154-4108-9d0b-28b2e876914b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:53.828945 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b1abd-c154-4108-9d0b-28b2e876914b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:53.829235 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b1abd-c154-4108-9d0b-28b2e876914b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:53.829516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b1abd-c154-4108-9d0b-28b2e876914b None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:53.830776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b1abd-c154-4108-9d0b-28b2e876914b None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:53.832324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b1abd-c154-4108-9d0b-28b2e876914b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:53.834343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 61/128] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:34:53 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:53.835144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b1abd-c154-4108-9d0b-28b2e876914b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:53.893139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:53.934761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c44cdbe-dc12-4225-99e9-11cbb6675e19 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:53.953883 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b1abd-c154-4108-9d0b-28b2e876914b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:53.973884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85826bb7-b206-4c14-b348-7e392c125a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:53.975470 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85826bb7-b206-4c14-b348-7e392c125a6b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:53.975907 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85826bb7-b206-4c14-b348-7e392c125a6b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:53.976344 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85826bb7-b206-4c14-b348-7e392c125a6b None admin] PATH_INFO: `/v3/users/64937d35ffd9426ca7084e0272d22ff3` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:53.977903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85826bb7-b206-4c14-b348-7e392c125a6b None admin] RBAC: Authorizing `identity:get_user(user_id=64937d35ffd9426ca7084e0272d22ff3)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:53.979652 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85826bb7-b206-4c14-b348-7e392c125a6b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:53.981532 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 68/129] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:53 2022] GET /identity/v3/users/64937d35ffd9426ca7084e0272d22ff3 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:53.982480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85826bb7-b206-4c14-b348-7e392c125a6b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:54.004217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf7f6-3231-435a-8e46-3856c32c7d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:54.005277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf7f6-3231-435a-8e46-3856c32c7d5f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:54.005656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf7f6-3231-435a-8e46-3856c32c7d5f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:54.006099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbcf7f6-3231-435a-8e46-3856c32c7d5f None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:54.006876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcf7f6-3231-435a-8e46-3856c32c7d5f None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:54.007260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcf7f6-3231-435a-8e46-3856c32c7d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:54.008865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbcf7f6-3231-435a-8e46-3856c32c7d5f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:54.020481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 62/130] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:34:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:54.026164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf7f6-3231-435a-8e46-3856c32c7d5f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:54.071854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:54.116307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85826bb7-b206-4c14-b348-7e392c125a6b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:54.153327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:54.159241 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403b391-17fb-4f61-aa1a-70d55de5d320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:54.159970 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403b391-17fb-4f61-aa1a-70d55de5d320 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:54.160269 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403b391-17fb-4f61-aa1a-70d55de5d320 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:54.160768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b403b391-17fb-4f61-aa1a-70d55de5d320 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:54.162296 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403b391-17fb-4f61-aa1a-70d55de5d320 None admin] RBAC: Adding query filter params (role.id=475524a4f2b44b66a7c5935c0ded858e, scope.project.id=2614591ccb4e488ba922d8212cdc54ee, user.id=bcf87e6e0dbc4c99a65ef1cf4c43f4ac) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:54.162685 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403b391-17fb-4f61-aa1a-70d55de5d320 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:54.164837 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b403b391-17fb-4f61-aa1a-70d55de5d320 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:54.170076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbcf7f6-3231-435a-8e46-3856c32c7d5f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:54.176907 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 69/131] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:34:53 2022] GET /identity/v3/role_assignments?user.id=bcf87e6e0dbc4c99a65ef1cf4c43f4ac&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=475524a4f2b44b66a7c5935c0ded858e => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:54.178428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403b391-17fb-4f61-aa1a-70d55de5d320 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:54.222318 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62c917-0eb9-43c5-b3fb-e35a11521413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:54.225118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62c917-0eb9-43c5-b3fb-e35a11521413 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:54.225599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62c917-0eb9-43c5-b3fb-e35a11521413 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:54.227166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62c917-0eb9-43c5-b3fb-e35a11521413 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee/users/d2ab45f210bf4b3e95c9f9052c7354eb/roles/293f9e8d2aba452aadef740529c3d498` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:54.233924 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62c917-0eb9-43c5-b3fb-e35a11521413 None admin] RBAC: Authorizing `identity:create_grant(project_id=2614591ccb4e488ba922d8212cdc54ee, user_id=d2ab45f210bf4b3e95c9f9052c7354eb, role_id=293f9e8d2aba452aadef740529c3d498)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:54.235730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62c917-0eb9-43c5-b3fb-e35a11521413 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:54.272349 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 63/132] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:34:54 2022] PUT /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee/users/d2ab45f210bf4b3e95c9f9052c7354eb/roles/293f9e8d2aba452aadef740529c3d498 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:34:54.273606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62c917-0eb9-43c5-b3fb-e35a11521413 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:54.402378 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b403b391-17fb-4f61-aa1a-70d55de5d320 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:54.450193 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5470-b369-46ec-8ea8-08fb3459ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:54.450415 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5470-b369-46ec-8ea8-08fb3459ac88 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:54.450665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5470-b369-46ec-8ea8-08fb3459ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:54.450950 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac5470-b369-46ec-8ea8-08fb3459ac88 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:54.453066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac5470-b369-46ec-8ea8-08fb3459ac88 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:54.454770 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ac5470-b369-46ec-8ea8-08fb3459ac88 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:54.456762 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 70/133] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:34:54 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:54.462797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:54.464801 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5470-b369-46ec-8ea8-08fb3459ac88 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:54.477252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62c917-0eb9-43c5-b3fb-e35a11521413 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:54.570613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7d1ed-e87a-4598-a86e-88b0ed7d15e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:54.572776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7d1ed-e87a-4598-a86e-88b0ed7d15e1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:54.573068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7d1ed-e87a-4598-a86e-88b0ed7d15e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:54.573464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7d1ed-e87a-4598-a86e-88b0ed7d15e1 None admin] PATH_INFO: `/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:54.575854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7d1ed-e87a-4598-a86e-88b0ed7d15e1 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ab45f210bf4b3e95c9f9052c7354eb)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:54.586146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7d1ed-e87a-4598-a86e-88b0ed7d15e1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:54.588675 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 64/134] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:54 2022] GET /identity/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:54.595902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7d1ed-e87a-4598-a86e-88b0ed7d15e1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:54.649950 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:54.757656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac5470-b369-46ec-8ea8-08fb3459ac88 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:54.814837 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa238-554b-489c-b339-22ac3ef3ff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:54.815790 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa238-554b-489c-b339-22ac3ef3ff63 None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:54.816079 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa238-554b-489c-b339-22ac3ef3ff63 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:54.816358 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa238-554b-489c-b339-22ac3ef3ff63 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee/users/64937d35ffd9426ca7084e0272d22ff3/roles/f315b062be7e445fa9461a116f9c46ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:54.822196 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa238-554b-489c-b339-22ac3ef3ff63 None admin] RBAC: Authorizing `identity:create_grant(project_id=2614591ccb4e488ba922d8212cdc54ee, user_id=64937d35ffd9426ca7084e0272d22ff3, role_id=f315b062be7e445fa9461a116f9c46ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:54.823585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7d1ed-e87a-4598-a86e-88b0ed7d15e1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:54.824079 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa238-554b-489c-b339-22ac3ef3ff63 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:54.847576 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 71/135] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:34:54 2022] PUT /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee/users/64937d35ffd9426ca7084e0272d22ff3/roles/f315b062be7e445fa9461a116f9c46ee => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:34:54.910449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180ad8d-9323-4692-825a-85607e7c1f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:54.911751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ad8d-9323-4692-825a-85607e7c1f41 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:54.912391 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ad8d-9323-4692-825a-85607e7c1f41 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:54.912913 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180ad8d-9323-4692-825a-85607e7c1f41 None admin] PATH_INFO: `/v3/projects/ea05dad56d304d4d8bd86333624f0c10` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:54.916648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180ad8d-9323-4692-825a-85607e7c1f41 None admin] RBAC: Authorizing `identity:get_project(project_id=ea05dad56d304d4d8bd86333624f0c10)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:54.918832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4180ad8d-9323-4692-825a-85607e7c1f41 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:54.921087 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 65/136] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:34:54 2022] GET /identity/v3/projects/ea05dad56d304d4d8bd86333624f0c10 => generated 312 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:54.927888 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa238-554b-489c-b339-22ac3ef3ff63 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:55.052560 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa238-554b-489c-b339-22ac3ef3ff63 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:55.079690 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:55.095996 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d349f-b832-4883-9e4f-8be56c6b6502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:55.096990 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d349f-b832-4883-9e4f-8be56c6b6502 None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:55.097275 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d349f-b832-4883-9e4f-8be56c6b6502 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:55.097559 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d349f-b832-4883-9e4f-8be56c6b6502 None admin] PATH_INFO: `/v3/projects/ea05dad56d304d4d8bd86333624f0c10/users/d2ab45f210bf4b3e95c9f9052c7354eb/roles/52b41e61eb19402aa67a7defc45d7f5f` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:55.099795 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d349f-b832-4883-9e4f-8be56c6b6502 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea05dad56d304d4d8bd86333624f0c10, user_id=d2ab45f210bf4b3e95c9f9052c7354eb, role_id=52b41e61eb19402aa67a7defc45d7f5f)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:55.106309 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d349f-b832-4883-9e4f-8be56c6b6502 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:55.131143 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 72/137] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:34:54 2022] PUT /identity/v3/projects/ea05dad56d304d4d8bd86333624f0c10/users/d2ab45f210bf4b3e95c9f9052c7354eb/roles/52b41e61eb19402aa67a7defc45d7f5f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:34:55.446500 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd3872-48a6-4fa3-863c-15e0155252ef None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:55.447497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd3872-48a6-4fa3-863c-15e0155252ef None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:55.447996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd3872-48a6-4fa3-863c-15e0155252ef None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:55.449843 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 66/138] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:55.455545 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22daeb-6d26-4f9d-ad1d-3929e892c814 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:55.455850 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22daeb-6d26-4f9d-ad1d-3929e892c814 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:55.456121 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22daeb-6d26-4f9d-ad1d-3929e892c814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:55.477682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-df22daeb-6d26-4f9d-ad1d-3929e892c814 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:55.479005 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-df22daeb-6d26-4f9d-ad1d-3929e892c814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:55.524988 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13ddb7-0166-437d-acab-33a7f9185882 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:55.525519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13ddb7-0166-437d-acab-33a7f9185882 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:55.526039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13ddb7-0166-437d-acab-33a7f9185882 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:55.529018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 67/139] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:55.535956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d5be-4e43-4745-bc1b-dc521a174f5b None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:55.536515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d5be-4e43-4745-bc1b-dc521a174f5b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:55.537033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270d5be-4e43-4745-bc1b-dc521a174f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:55.590684 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f270d5be-4e43-4745-bc1b-dc521a174f5b None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:55.592282 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f270d5be-4e43-4745-bc1b-dc521a174f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:55.632090 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 73/140] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:55.651066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:55.674743 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22daeb-6d26-4f9d-ad1d-3929e892c814 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:55.724730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 68/141] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:34:55.778236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d5be-4e43-4745-bc1b-dc521a174f5b None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:55.858198 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22daeb-6d26-4f9d-ad1d-3929e892c814 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:55.906623 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:55.912003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270d5be-4e43-4745-bc1b-dc521a174f5b None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:55.961479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9abaf-59c2-44c7-a1a2-7e757ff7a48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:55.962743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9abaf-59c2-44c7-a1a2-7e757ff7a48e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:55.963227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9abaf-59c2-44c7-a1a2-7e757ff7a48e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:55.963881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9abaf-59c2-44c7-a1a2-7e757ff7a48e None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:55.965855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9abaf-59c2-44c7-a1a2-7e757ff7a48e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:55.968148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe9abaf-59c2-44c7-a1a2-7e757ff7a48e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:55.971508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 69/142] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:34:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:34:55.975472 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8726a-bdd8-45cb-8acc-a409bafea62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:55.976623 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8726a-bdd8-45cb-8acc-a409bafea62f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:55.977681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9abaf-59c2-44c7-a1a2-7e757ff7a48e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:55.978623 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8726a-bdd8-45cb-8acc-a409bafea62f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:55.979524 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8726a-bdd8-45cb-8acc-a409bafea62f None admin] PATH_INFO: `/v3/roles/member` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:56.013893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f8726a-bdd8-45cb-8acc-a409bafea62f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:56.035863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-b3f8726a-bdd8-45cb-8acc-a409bafea62f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:56.037968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:56.038845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:56.039676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:34:56.040361 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 74/143] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:34:56.050502 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8726a-bdd8-45cb-8acc-a409bafea62f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:56.222587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe9abaf-59c2-44c7-a1a2-7e757ff7a48e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:56.290721 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8726a-bdd8-45cb-8acc-a409bafea62f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:56.312990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bcec8-2fa6-4223-802d-fd8c33d39355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:56.313720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bcec8-2fa6-4223-802d-fd8c33d39355 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:56.314017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bcec8-2fa6-4223-802d-fd8c33d39355 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:56.314303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762bcec8-2fa6-4223-802d-fd8c33d39355 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:56.315054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bcec8-2fa6-4223-802d-fd8c33d39355 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:56.316686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762bcec8-2fa6-4223-802d-fd8c33d39355 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:56.358701 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4c114-8903-4e89-880c-6c3d37097629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:56.359395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c114-8903-4e89-880c-6c3d37097629 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:56.359682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c114-8903-4e89-880c-6c3d37097629 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:56.359960 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4c114-8903-4e89-880c-6c3d37097629 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:56.360761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4c114-8903-4e89-880c-6c3d37097629 None admin] RBAC: Adding query filter params (name=member) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:56.361072 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4c114-8903-4e89-880c-6c3d37097629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:56.362640 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4c114-8903-4e89-880c-6c3d37097629 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:56.367541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 70/144] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:34:55 2022] POST /identity/v3/users => generated 283 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:34:56.384813 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 75/145] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:34:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:56.390527 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bcec8-2fa6-4223-802d-fd8c33d39355 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:56.549256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:56.568319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762bcec8-2fa6-4223-802d-fd8c33d39355 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:56.609168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74229c2-9b88-4e28-a72e-f5037b682d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:56.610075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74229c2-9b88-4e28-a72e-f5037b682d54 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:56.610360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74229c2-9b88-4e28-a72e-f5037b682d54 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:56.610639 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74229c2-9b88-4e28-a72e-f5037b682d54 None admin] PATH_INFO: `/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:56.611909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74229c2-9b88-4e28-a72e-f5037b682d54 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ab45f210bf4b3e95c9f9052c7354eb)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:56.613466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74229c2-9b88-4e28-a72e-f5037b682d54 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:56.615191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 71/146] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:56 2022] GET /identity/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:56.621228 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4c114-8903-4e89-880c-6c3d37097629 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:56.693793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:56.789322 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4c114-8903-4e89-880c-6c3d37097629 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:56.845433 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded18a5f-358e-459c-baef-d8f7d8088e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:56.846027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded18a5f-358e-459c-baef-d8f7d8088e53 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:56.846311 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded18a5f-358e-459c-baef-d8f7d8088e53 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:56.846581 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded18a5f-358e-459c-baef-d8f7d8088e53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:56.941435 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded18a5f-358e-459c-baef-d8f7d8088e53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:56.942948 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded18a5f-358e-459c-baef-d8f7d8088e53 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:56.993697 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:57.085252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 76/147] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:34:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:34:57.090647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74229c2-9b88-4e28-a72e-f5037b682d54 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:57.239283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74229c2-9b88-4e28-a72e-f5037b682d54 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:57.279741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc538-c8f9-486a-b4fd-f84a8dbdb240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:57.281078 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc538-c8f9-486a-b4fd-f84a8dbdb240 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:57.281587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc538-c8f9-486a-b4fd-f84a8dbdb240 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:57.282075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc538-c8f9-486a-b4fd-f84a8dbdb240 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:57.283690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afc538-c8f9-486a-b4fd-f84a8dbdb240 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:57.285407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afc538-c8f9-486a-b4fd-f84a8dbdb240 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:57.287430 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 72/148] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:34:57 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:57.297620 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded18a5f-358e-459c-baef-d8f7d8088e53 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:57.447687 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded18a5f-358e-459c-baef-d8f7d8088e53 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:57.485543 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ac998-d10f-423e-ba46-9f42bd420bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:57.486219 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ac998-d10f-423e-ba46-9f42bd420bfa None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:57.486505 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ac998-d10f-423e-ba46-9f42bd420bfa None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:57.486791 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ac998-d10f-423e-ba46-9f42bd420bfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:57.487648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ac998-d10f-423e-ba46-9f42bd420bfa None admin] RBAC: Adding query filter params (role.id=52b41e61eb19402aa67a7defc45d7f5f, scope.project.id=2614591ccb4e488ba922d8212cdc54ee, user.id=d2ab45f210bf4b3e95c9f9052c7354eb) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:57.487962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ac998-d10f-423e-ba46-9f42bd420bfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:57.489626 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785ac998-d10f-423e-ba46-9f42bd420bfa None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:57.497861 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:57.502626 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 77/149] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:34:57 2022] GET /identity/v3/role_assignments?user.id=d2ab45f210bf4b3e95c9f9052c7354eb&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:57.598516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812e566-2613-4c08-a892-12082a537672 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:57.599509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812e566-2613-4c08-a892-12082a537672 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:57.599992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812e566-2613-4c08-a892-12082a537672 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:57.601819 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 73/150] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:57.608117 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa520a7b-fe61-4704-94c5-5b2138adac1c None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:57.608406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa520a7b-fe61-4704-94c5-5b2138adac1c None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:57.608752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa520a7b-fe61-4704-94c5-5b2138adac1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:57.639387 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-aa520a7b-fe61-4704-94c5-5b2138adac1c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:57.640651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-aa520a7b-fe61-4704-94c5-5b2138adac1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:57.728634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 78/151] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:34:57.753879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812e566-2613-4c08-a892-12082a537672 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:57.789887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:57.905421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812e566-2613-4c08-a892-12082a537672 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:57.950857 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fedff2-d5d6-4ba7-b064-271940818923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:57.951690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fedff2-d5d6-4ba7-b064-271940818923 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:57.951973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fedff2-d5d6-4ba7-b064-271940818923 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:57.952248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fedff2-d5d6-4ba7-b064-271940818923 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:57.967167 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fedff2-d5d6-4ba7-b064-271940818923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-d4fedff2-d5d6-4ba7-b064-271940818923 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:57.975007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:57.975887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:34:57.976686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:34:57.978388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 74/152] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:57.983349 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa520a7b-fe61-4704-94c5-5b2138adac1c None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:58.142419 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa520a7b-fe61-4704-94c5-5b2138adac1c None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:58.177560 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:58.183525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49af5840-cb80-4208-8ae6-8f7dbd8fc192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:58.184228 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af5840-cb80-4208-8ae6-8f7dbd8fc192 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:58.184648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af5840-cb80-4208-8ae6-8f7dbd8fc192 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:58.184852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49af5840-cb80-4208-8ae6-8f7dbd8fc192 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:58.185573 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af5840-cb80-4208-8ae6-8f7dbd8fc192 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:58.185880 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af5840-cb80-4208-8ae6-8f7dbd8fc192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:58.187310 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49af5840-cb80-4208-8ae6-8f7dbd8fc192 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:58.201465 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 79/153] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:34:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:58.207471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fedff2-d5d6-4ba7-b064-271940818923 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:58.327307 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:58.351224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fedff2-d5d6-4ba7-b064-271940818923 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:58.389658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f7842-5c4a-4ab6-9851-0e09daea7a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:58.390554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7842-5c4a-4ab6-9851-0e09daea7a7c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:58.390837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7842-5c4a-4ab6-9851-0e09daea7a7c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:58.391113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f7842-5c4a-4ab6-9851-0e09daea7a7c None admin] PATH_INFO: `/v3/users/bcf87e6e0dbc4c99a65ef1cf4c43f4ac` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:58.393435 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f7842-5c4a-4ab6-9851-0e09daea7a7c None admin] RBAC: Authorizing `identity:get_user(user_id=bcf87e6e0dbc4c99a65ef1cf4c43f4ac)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:58.393747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d075bf-f319-410a-aa37-e406b8bc0685 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:58.394174 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d075bf-f319-410a-aa37-e406b8bc0685 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:58.394339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d075bf-f319-410a-aa37-e406b8bc0685 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:58.394863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f7842-5c4a-4ab6-9851-0e09daea7a7c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:58.395693 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 80/154] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:58.397116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 75/155] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:58 2022] GET /identity/v3/users/bcf87e6e0dbc4c99a65ef1cf4c43f4ac => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:58.402795 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d075bf-f319-410a-aa37-e406b8bc0685 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:58.411927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf69f2-6385-4072-b6f0-111632e93cd5 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:58.412207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf69f2-6385-4072-b6f0-111632e93cd5 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:58.412512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf69f2-6385-4072-b6f0-111632e93cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:58.446957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-33cf69f2-6385-4072-b6f0-111632e93cd5 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:58.448250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-33cf69f2-6385-4072-b6f0-111632e93cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:58.626814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 76/156] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:58.654389 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d075bf-f319-410a-aa37-e406b8bc0685 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:58.688364 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf69f2-6385-4072-b6f0-111632e93cd5 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:58.723964 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c537d9-49b3-4b99-a80d-94b60a397489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:58.725207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c537d9-49b3-4b99-a80d-94b60a397489 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:58.725497 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c537d9-49b3-4b99-a80d-94b60a397489 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:58.725773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c537d9-49b3-4b99-a80d-94b60a397489 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:58.730911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c537d9-49b3-4b99-a80d-94b60a397489 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:58.732945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c537d9-49b3-4b99-a80d-94b60a397489 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:58.735826 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 81/157] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:34:58 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:58.741716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c537d9-49b3-4b99-a80d-94b60a397489 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:58.833927 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:58.882905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:58.911408 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c537d9-49b3-4b99-a80d-94b60a397489 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:58.930877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf69f2-6385-4072-b6f0-111632e93cd5 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:58.992327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabd69c-0006-42f0-bbca-f5d10909104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:58.994510 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabd69c-0006-42f0-bbca-f5d10909104d None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:58.996820 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabd69c-0006-42f0-bbca-f5d10909104d None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:58.997366 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabd69c-0006-42f0-bbca-f5d10909104d None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee/users/bcf87e6e0dbc4c99a65ef1cf4c43f4ac/roles/475524a4f2b44b66a7c5935c0ded858e` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:59.001838 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabd69c-0006-42f0-bbca-f5d10909104d None admin] RBAC: Authorizing `identity:create_grant(project_id=2614591ccb4e488ba922d8212cdc54ee, user_id=bcf87e6e0dbc4c99a65ef1cf4c43f4ac, role_id=475524a4f2b44b66a7c5935c0ded858e)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:59.004643 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabd69c-0006-42f0-bbca-f5d10909104d None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:59.011365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0c483-b9b1-4f6b-8872-5a636860ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:59.012828 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c483-b9b1-4f6b-8872-5a636860ad6e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:59.014273 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c483-b9b1-4f6b-8872-5a636860ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:59.015251 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0c483-b9b1-4f6b-8872-5a636860ad6e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:59.033503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 82/158] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:34:58 2022] PUT /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee/users/bcf87e6e0dbc4c99a65ef1cf4c43f4ac/roles/475524a4f2b44b66a7c5935c0ded858e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:34:59.035372 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8235c1-50de-44cd-9a96-ce6900c26e15 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:59.035984 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8235c1-50de-44cd-9a96-ce6900c26e15 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:59.040218 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8235c1-50de-44cd-9a96-ce6900c26e15 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:59.043244 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 83/159] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:59.044745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0c483-b9b1-4f6b-8872-5a636860ad6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:59.046430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f7e9b-63c8-45d3-b3b2-cb8b8006e815 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-e4f0c483-b9b1-4f6b-8872-5a636860ad6e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:59.054973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:59.055902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:34:59.056690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:34:59.059036 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f7e9b-63c8-45d3-b3b2-cb8b8006e815 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:59.059562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f7e9b-63c8-45d3-b3b2-cb8b8006e815 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:59.061430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 84/160] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:34:59 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:34:59.062968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2b0c-a043-4cb0-8791-a13bee401516 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:59.063528 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2b0c-a043-4cb0-8791-a13bee401516 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:59.064007 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c2b0c-a043-4cb0-8791-a13bee401516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:59.071167 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 77/161] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:34:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:34:59.076736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a39ef2-df5d-4d97-b98d-6104fd0dbe28 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:59.078239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a39ef2-df5d-4d97-b98d-6104fd0dbe28 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:59.078961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a39ef2-df5d-4d97-b98d-6104fd0dbe28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:59.099111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-27a39ef2-df5d-4d97-b98d-6104fd0dbe28 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:59.100725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-27a39ef2-df5d-4d97-b98d-6104fd0dbe28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:59.101687 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-6d3c2b0c-a043-4cb0-8791-a13bee401516 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:34:59.102894 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-6d3c2b0c-a043-4cb0-8791-a13bee401516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:34:59.228459 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 78/162] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:59.228459 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a39ef2-df5d-4d97-b98d-6104fd0dbe28 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:59.291898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 85/163] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:34:59.321937 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c2b0c-a043-4cb0-8791-a13bee401516 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:59.406445 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:59.466908 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:59.508272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a39ef2-df5d-4d97-b98d-6104fd0dbe28 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:59.587357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238e6b4-254d-46a2-9d43-f0d1466fd352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:59.589062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e6b4-254d-46a2-9d43-f0d1466fd352 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:59.589175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e6b4-254d-46a2-9d43-f0d1466fd352 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:59.589422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238e6b4-254d-46a2-9d43-f0d1466fd352 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:59.590409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238e6b4-254d-46a2-9d43-f0d1466fd352 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:34:59.590725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238e6b4-254d-46a2-9d43-f0d1466fd352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:59.592490 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238e6b4-254d-46a2-9d43-f0d1466fd352 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:59.603411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 79/164] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:34:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:59.604491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238e6b4-254d-46a2-9d43-f0d1466fd352 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:59.611667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c2b0c-a043-4cb0-8791-a13bee401516 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:59.666463 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f7f76-8dbc-4cd7-8451-257a8d9f0ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:59.667716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f7f76-8dbc-4cd7-8451-257a8d9f0ad7 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:59.669322 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f7f76-8dbc-4cd7-8451-257a8d9f0ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:59.669813 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5f7f76-8dbc-4cd7-8451-257a8d9f0ad7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:59.691499 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5f7f76-8dbc-4cd7-8451-257a8d9f0ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-af5f7f76-8dbc-4cd7-8451-257a8d9f0ad7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:59.699867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:59.700724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:34:59.701461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:34:59.709995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 86/165] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:34:59.711091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f7f76-8dbc-4cd7-8451-257a8d9f0ad7 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:59.783931 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238e6b4-254d-46a2-9d43-f0d1466fd352 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:59.838169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5f7f76-8dbc-4cd7-8451-257a8d9f0ad7 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:34:59.850433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:59.860386 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:34:59.874114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a5912-4202-4be7-8728-efbaa8bfb8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:59.874940 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5912-4202-4be7-8728-efbaa8bfb8c4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:59.875225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5912-4202-4be7-8728-efbaa8bfb8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:59.875504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251a5912-4202-4be7-8728-efbaa8bfb8c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:59.911647 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c2625-65be-4466-ba61-5fe382c34191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:34:59.913091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c2625-65be-4466-ba61-5fe382c34191 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:34:59.913351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251a5912-4202-4be7-8728-efbaa8bfb8c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:34:59.913768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c2625-65be-4466-ba61-5fe382c34191 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:34:59.914247 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72c2625-65be-4466-ba61-5fe382c34191 None admin] PATH_INFO: `/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:34:59.915655 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c2625-65be-4466-ba61-5fe382c34191 None admin] RBAC: Authorizing `identity:get_user(user_id=d2ab45f210bf4b3e95c9f9052c7354eb)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:34:59.917418 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72c2625-65be-4466-ba61-5fe382c34191 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:34:59.919477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 87/166] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:34:59 2022] GET /identity/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:34:59.920470 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c2625-65be-4466-ba61-5fe382c34191 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-251a5912-4202-4be7-8728-efbaa8bfb8c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:34:59.929860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:34:59.930816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:34:59.931562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 80/167] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:34:59.932184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a5912-4202-4be7-8728-efbaa8bfb8c4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:00.088097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72c2625-65be-4466-ba61-5fe382c34191 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:00.130436 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032ac36-8991-455f-b926-b6a5cb33aaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:00.131226 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032ac36-8991-455f-b926-b6a5cb33aaf4 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:00.131516 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032ac36-8991-455f-b926-b6a5cb33aaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:00.131796 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032ac36-8991-455f-b926-b6a5cb33aaf4 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:00.132843 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032ac36-8991-455f-b926-b6a5cb33aaf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:00.133041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032ac36-8991-455f-b926-b6a5cb33aaf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:00.134603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c032ac36-8991-455f-b926-b6a5cb33aaf4 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:00.145899 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 88/168] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:00.146783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032ac36-8991-455f-b926-b6a5cb33aaf4 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:00.173342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251a5912-4202-4be7-8728-efbaa8bfb8c4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:00.209790 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:00.215627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd670fb-2215-4b24-b37d-cba9d6020410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:00.216426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd670fb-2215-4b24-b37d-cba9d6020410 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:00.217106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd670fb-2215-4b24-b37d-cba9d6020410 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:00.217387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd670fb-2215-4b24-b37d-cba9d6020410 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:00.293112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:00.298608 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032ac36-8991-455f-b926-b6a5cb33aaf4 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:00.305968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd670fb-2215-4b24-b37d-cba9d6020410 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:00.308151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd670fb-2215-4b24-b37d-cba9d6020410 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:00.340134 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae3bf0-d723-49c9-b2fd-2b52a4f64f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:00.340805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae3bf0-d723-49c9-b2fd-2b52a4f64f2e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:00.341095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae3bf0-d723-49c9-b2fd-2b52a4f64f2e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:00.341384 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ae3bf0-d723-49c9-b2fd-2b52a4f64f2e None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:00.342336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae3bf0-d723-49c9-b2fd-2b52a4f64f2e None admin] RBAC: Adding query filter params (name=member) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:00.342650 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae3bf0-d723-49c9-b2fd-2b52a4f64f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:00.344065 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ae3bf0-d723-49c9-b2fd-2b52a4f64f2e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:00.357773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 89/169] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:00.358852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae3bf0-d723-49c9-b2fd-2b52a4f64f2e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:00.432710 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 81/170] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:34:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:00.433875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd670fb-2215-4b24-b37d-cba9d6020410 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:00.553507 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ae3bf0-d723-49c9-b2fd-2b52a4f64f2e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:00.562183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:00.634647 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4bdf9-7aa1-4106-88c3-4c77ad870c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:00.635782 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4bdf9-7aa1-4106-88c3-4c77ad870c41 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:00.636066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4bdf9-7aa1-4106-88c3-4c77ad870c41 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:00.636341 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4bdf9-7aa1-4106-88c3-4c77ad870c41 None admin] PATH_INFO: `/v3/users/64937d35ffd9426ca7084e0272d22ff3` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:00.641594 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4bdf9-7aa1-4106-88c3-4c77ad870c41 None admin] RBAC: Authorizing `identity:get_user(user_id=64937d35ffd9426ca7084e0272d22ff3)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:00.643416 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4bdf9-7aa1-4106-88c3-4c77ad870c41 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:00.645891 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 90/171] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:00 2022] GET /identity/v3/users/64937d35ffd9426ca7084e0272d22ff3 => generated 247 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:00.646589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4bdf9-7aa1-4106-88c3-4c77ad870c41 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:00.651725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:00.678258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd670fb-2215-4b24-b37d-cba9d6020410 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:00.771451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a65573-8608-43b6-87a4-a62a04d9af1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:00.772421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a65573-8608-43b6-87a4-a62a04d9af1c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:00.772729 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a65573-8608-43b6-87a4-a62a04d9af1c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:00.773056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a65573-8608-43b6-87a4-a62a04d9af1c None admin] PATH_INFO: `/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:00.774302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a65573-8608-43b6-87a4-a62a04d9af1c None admin] RBAC: Authorizing `identity:get_user(user_id=d2ab45f210bf4b3e95c9f9052c7354eb)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:00.775799 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a65573-8608-43b6-87a4-a62a04d9af1c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:00.781999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 82/172] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:00 2022] GET /identity/v3/users/d2ab45f210bf4b3e95c9f9052c7354eb => generated 275 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:00.782929 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a65573-8608-43b6-87a4-a62a04d9af1c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:00.809226 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4bdf9-7aa1-4106-88c3-4c77ad870c41 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:00.901972 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306c6ec-9478-4dab-909b-300b4166ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:00.902806 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306c6ec-9478-4dab-909b-300b4166ff50 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:00.903098 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306c6ec-9478-4dab-909b-300b4166ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:00.903377 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b306c6ec-9478-4dab-909b-300b4166ff50 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:00.909284 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306c6ec-9478-4dab-909b-300b4166ff50 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:00.910776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b306c6ec-9478-4dab-909b-300b4166ff50 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:00.912942 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 91/173] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:00 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:00.913755 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306c6ec-9478-4dab-909b-300b4166ff50 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:01.002819 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:01.013155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a65573-8608-43b6-87a4-a62a04d9af1c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:01.087385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccecb-025a-41ba-95d1-0824e5102e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:01.088062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccecb-025a-41ba-95d1-0824e5102e75 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.088466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccecb-025a-41ba-95d1-0824e5102e75 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.089424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccecb-025a-41ba-95d1-0824e5102e75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.092305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b306c6ec-9478-4dab-909b-300b4166ff50 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:01.139263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f1c76-e8b3-48e5-a965-7885ee60289e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:01.139950 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f1c76-e8b3-48e5-a965-7885ee60289e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.140229 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f1c76-e8b3-48e5-a965-7885ee60289e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.140524 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f1c76-e8b3-48e5-a965-7885ee60289e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.146577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:01.237438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ccecb-025a-41ba-95d1-0824e5102e75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:01.239884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ccecb-025a-41ba-95d1-0824e5102e75 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:01.298933 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f1c76-e8b3-48e5-a965-7885ee60289e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:01.300803 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f1c76-e8b3-48e5-a965-7885ee60289e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:01.366684 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 83/174] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:01.373042 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccecb-025a-41ba-95d1-0824e5102e75 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:01.398749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:01.446401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:01.496662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccecb-025a-41ba-95d1-0824e5102e75 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:01.537463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1356b-1052-465c-87d3-bdd461971658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:01.538386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1356b-1052-465c-87d3-bdd461971658 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.538837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1356b-1052-465c-87d3-bdd461971658 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.539249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1356b-1052-465c-87d3-bdd461971658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.540238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1356b-1052-465c-87d3-bdd461971658 None admin] RBAC: Adding query filter params (role.id=293f9e8d2aba452aadef740529c3d498, scope.project.id=2614591ccb4e488ba922d8212cdc54ee, user.id=d2ab45f210bf4b3e95c9f9052c7354eb) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:01.540790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1356b-1052-465c-87d3-bdd461971658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:01.543258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1356b-1052-465c-87d3-bdd461971658 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:01.550918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 84/175] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:01 2022] GET /identity/v3/role_assignments?user.id=d2ab45f210bf4b3e95c9f9052c7354eb&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=293f9e8d2aba452aadef740529c3d498 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:01.552710 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ebadf-b325-47ce-aa09-6b089c2db068 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.553362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ebadf-b325-47ce-aa09-6b089c2db068 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.553801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ebadf-b325-47ce-aa09-6b089c2db068 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.560795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 85/176] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:01.562351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ebadf-b325-47ce-aa09-6b089c2db068 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:01.600107 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 92/177] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:01.601713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e548d-a416-4b45-9449-98dfc35103a8 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.602312 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e548d-a416-4b45-9449-98dfc35103a8 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.602855 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e548d-a416-4b45-9449-98dfc35103a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.631477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-981e548d-a416-4b45-9449-98dfc35103a8 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:01.633597 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-981e548d-a416-4b45-9449-98dfc35103a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:01.788657 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ebadf-b325-47ce-aa09-6b089c2db068 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:01.803889 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 93/178] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:01.805153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e548d-a416-4b45-9449-98dfc35103a8 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:01.827906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:01.842029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55e1e2-850c-4e68-be6c-68e4ae0eac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:01.843552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55e1e2-850c-4e68-be6c-68e4ae0eac51 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.844006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55e1e2-850c-4e68-be6c-68e4ae0eac51 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.844407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55e1e2-850c-4e68-be6c-68e4ae0eac51 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.846155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55e1e2-850c-4e68-be6c-68e4ae0eac51 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:01.848588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55e1e2-850c-4e68-be6c-68e4ae0eac51 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:01.850755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 86/179] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:01 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:01.856875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424621c-bbc5-4f73-967b-aea8bf606366 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.857436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424621c-bbc5-4f73-967b-aea8bf606366 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.858195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424621c-bbc5-4f73-967b-aea8bf606366 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.862012 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 87/180] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:01.864731 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715b0de-b558-46a9-ae96-fd55e2954a90 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.865254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715b0de-b558-46a9-ae96-fd55e2954a90 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.865699 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0715b0de-b558-46a9-ae96-fd55e2954a90 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.867726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 88/181] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:01.870200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83d26e-3418-49b3-9965-7749c0edc9b4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:01.870679 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83d26e-3418-49b3-9965-7749c0edc9b4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:01.871123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83d26e-3418-49b3-9965-7749c0edc9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:01.893440 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-be83d26e-3418-49b3-9965-7749c0edc9b4 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:01.895325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-be83d26e-3418-49b3-9965-7749c0edc9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:01.959297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:02.016048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 89/182] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:02.018314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83d26e-3418-49b3-9965-7749c0edc9b4 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.019120 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e548d-a416-4b45-9449-98dfc35103a8 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.066488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85cfc5f-e1dd-4aa4-80f7-ce9696331c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.067639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cfc5f-e1dd-4aa4-80f7-ce9696331c60 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.068056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cfc5f-e1dd-4aa4-80f7-ce9696331c60 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.068556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85cfc5f-e1dd-4aa4-80f7-ce9696331c60 None admin] PATH_INFO: `/v3/projects/ea05dad56d304d4d8bd86333624f0c10` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.070057 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cfc5f-e1dd-4aa4-80f7-ce9696331c60 None admin] RBAC: Authorizing `identity:get_project(project_id=ea05dad56d304d4d8bd86333624f0c10)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:02.071720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85cfc5f-e1dd-4aa4-80f7-ce9696331c60 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:02.073868 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 94/183] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:01 2022] GET /identity/v3/projects/ea05dad56d304d4d8bd86333624f0c10 => generated 312 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:02.075406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce4935-86df-4575-8f9f-15b1b061785c None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.075697 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce4935-86df-4575-8f9f-15b1b061785c None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.075972 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ce4935-86df-4575-8f9f-15b1b061785c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.093574 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-17ce4935-86df-4575-8f9f-15b1b061785c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:02.095058 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-17ce4935-86df-4575-8f9f-15b1b061785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:02.158135 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83d26e-3418-49b3-9965-7749c0edc9b4 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.178473 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 95/184] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:02.179579 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce4935-86df-4575-8f9f-15b1b061785c None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.199668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:02.224707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a3d9-fa23-40b5-912e-ea740ca5ae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.225697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a3d9-fa23-40b5-912e-ea740ca5ae5a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.225697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a3d9-fa23-40b5-912e-ea740ca5ae5a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.225950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364a3d9-fa23-40b5-912e-ea740ca5ae5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.226769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a3d9-fa23-40b5-912e-ea740ca5ae5a None admin] RBAC: Adding query filter params (role.id=f315b062be7e445fa9461a116f9c46ee, scope.project.id=2614591ccb4e488ba922d8212cdc54ee, user.id=64937d35ffd9426ca7084e0272d22ff3) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:02.227079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a3d9-fa23-40b5-912e-ea740ca5ae5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:02.228594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0364a3d9-fa23-40b5-912e-ea740ca5ae5a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:02.237027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 90/185] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:02 2022] GET /identity/v3/role_assignments?user.id=64937d35ffd9426ca7084e0272d22ff3&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=f315b062be7e445fa9461a116f9c46ee => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:02.238163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a3d9-fa23-40b5-912e-ea740ca5ae5a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.313736 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:02.383414 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ce4935-86df-4575-8f9f-15b1b061785c None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.431580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364a3d9-fa23-40b5-912e-ea740ca5ae5a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.438790 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ed9d2-87d4-4010-b47c-eb4794b7638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.439664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ed9d2-87d4-4010-b47c-eb4794b7638c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.439957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ed9d2-87d4-4010-b47c-eb4794b7638c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.440243 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713ed9d2-87d4-4010-b47c-eb4794b7638c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.456919 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713ed9d2-87d4-4010-b47c-eb4794b7638c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-713ed9d2-87d4-4010-b47c-eb4794b7638c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:02.467032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:02.474191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 96/186] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:02.476091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ed9d2-87d4-4010-b47c-eb4794b7638c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.496054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed8fe0-0fa7-4be8-b079-6634d90713ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.498063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed8fe0-0fa7-4be8-b079-6634d90713ec None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.498679 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed8fe0-0fa7-4be8-b079-6634d90713ec None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.499156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed8fe0-0fa7-4be8-b079-6634d90713ec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.513696 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed8fe0-0fa7-4be8-b079-6634d90713ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-3fed8fe0-0fa7-4be8-b079-6634d90713ec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:02.527887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:02.528965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:02.530099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:02.532670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 91/187] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:02.534136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed8fe0-0fa7-4be8-b079-6634d90713ec None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.605866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:02.626225 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713ed9d2-87d4-4010-b47c-eb4794b7638c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.664206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:02.676774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b2433-a5cb-47dc-b582-c8c0cb56e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.677619 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b2433-a5cb-47dc-b582-c8c0cb56e230 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.678137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b2433-a5cb-47dc-b582-c8c0cb56e230 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.678418 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b2433-a5cb-47dc-b582-c8c0cb56e230 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.679596 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b2433-a5cb-47dc-b582-c8c0cb56e230 None admin] RBAC: Adding query filter params (role.id=52b41e61eb19402aa67a7defc45d7f5f, scope.project.id=ea05dad56d304d4d8bd86333624f0c10, user.id=d2ab45f210bf4b3e95c9f9052c7354eb) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:02.679887 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b2433-a5cb-47dc-b582-c8c0cb56e230 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:02.681683 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b2433-a5cb-47dc-b582-c8c0cb56e230 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:02.689859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 97/188] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:02 2022] GET /identity/v3/role_assignments?user.id=d2ab45f210bf4b3e95c9f9052c7354eb&scope.project.id=ea05dad56d304d4d8bd86333624f0c10&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:02.690409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b2433-a5cb-47dc-b582-c8c0cb56e230 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.700552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed8fe0-0fa7-4be8-b079-6634d90713ec None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.761620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa80317-76f7-4f62-8912-bbf672352431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.763393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa80317-76f7-4f62-8912-bbf672352431 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.764176 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa80317-76f7-4f62-8912-bbf672352431 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.765317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa80317-76f7-4f62-8912-bbf672352431 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.767785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa80317-76f7-4f62-8912-bbf672352431 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:02.770644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa80317-76f7-4f62-8912-bbf672352431 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:02.772957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 92/189] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:02.774967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa80317-76f7-4f62-8912-bbf672352431 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.850243 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b2433-a5cb-47dc-b582-c8c0cb56e230 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.911366 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d89eaa-70b7-403c-b207-3534f5942b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:02.912316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d89eaa-70b7-403c-b207-3534f5942b0e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:02.912866 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d89eaa-70b7-403c-b207-3534f5942b0e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:02.913383 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d89eaa-70b7-403c-b207-3534f5942b0e None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:02.914847 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d89eaa-70b7-403c-b207-3534f5942b0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:02.915336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d89eaa-70b7-403c-b207-3534f5942b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:02.919012 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d89eaa-70b7-403c-b207-3534f5942b0e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:02.934421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 98/190] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:02.935720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d89eaa-70b7-403c-b207-3534f5942b0e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:02.945448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa80317-76f7-4f62-8912-bbf672352431 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:02.967421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:03.002588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79eb175-6cde-4449-b49b-469e25f113b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:03.003283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb175-6cde-4449-b49b-469e25f113b6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:03.003564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb175-6cde-4449-b49b-469e25f113b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:03.003847 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79eb175-6cde-4449-b49b-469e25f113b6 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:03.004659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79eb175-6cde-4449-b49b-469e25f113b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:03.004969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79eb175-6cde-4449-b49b-469e25f113b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:03.006388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79eb175-6cde-4449-b49b-469e25f113b6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:03.016200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 93/191] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:03.018031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b0ece-61ae-4038-8202-30870109636d None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:03.018323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b0ece-61ae-4038-8202-30870109636d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:03.019091 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b0ece-61ae-4038-8202-30870109636d None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:03.020186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 94/192] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:03.020747 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b0ece-61ae-4038-8202-30870109636d None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:03.031968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:03.094059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d89eaa-70b7-403c-b207-3534f5942b0e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:03.135092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14295d-7381-463f-839b-9fdcdae04428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:03.135641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b0ece-61ae-4038-8202-30870109636d None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:03.136400 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14295d-7381-463f-839b-9fdcdae04428 None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:03.136988 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14295d-7381-463f-839b-9fdcdae04428 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:03.137533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe14295d-7381-463f-839b-9fdcdae04428 None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:03.138916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14295d-7381-463f-839b-9fdcdae04428 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:03.141673 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe14295d-7381-463f-839b-9fdcdae04428 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:03.172239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc50e1-2621-4eb0-92aa-b92d3a4dec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:03.173023 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 99/193] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:02 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:03.173132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc50e1-2621-4eb0-92aa-b92d3a4dec2b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:03.173417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc50e1-2621-4eb0-92aa-b92d3a4dec2b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:03.173689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc50e1-2621-4eb0-92aa-b92d3a4dec2b None admin] PATH_INFO: `/v3/users/78b43c468c5d41459338a471a5c9280f` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:03.174373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14295d-7381-463f-839b-9fdcdae04428 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:03.194656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc50e1-2621-4eb0-92aa-b92d3a4dec2b None admin] RBAC: Authorizing `identity:get_user(user_id=78b43c468c5d41459338a471a5c9280f)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:03.196218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc50e1-2621-4eb0-92aa-b92d3a4dec2b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:03.198582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 95/194] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:03 2022] GET /identity/v3/users/78b43c468c5d41459338a471a5c9280f => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:03.199926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80cb7-a8dd-4b29-b209-8a1f976f73c1 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:03.200238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80cb7-a8dd-4b29-b209-8a1f976f73c1 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:03.200538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e80cb7-a8dd-4b29-b209-8a1f976f73c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:03.219187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-d9e80cb7-a8dd-4b29-b209-8a1f976f73c1 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:03.220705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-d9e80cb7-a8dd-4b29-b209-8a1f976f73c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:03.259071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:03.321115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 96/195] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:03.324218 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe14295d-7381-463f-839b-9fdcdae04428 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:03.332485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e80cb7-a8dd-4b29-b209-8a1f976f73c1 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:03.338208 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:03.377203 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a8f57-00bb-4f36-bdbd-d02dd31016db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:03.378160 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8f57-00bb-4f36-bdbd-d02dd31016db None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:03.378504 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8f57-00bb-4f36-bdbd-d02dd31016db None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:03.378810 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289a8f57-00bb-4f36-bdbd-d02dd31016db None admin] PATH_INFO: `/v3/users/78b43c468c5d41459338a471a5c9280f` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:03.380263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a8f57-00bb-4f36-bdbd-d02dd31016db None admin] RBAC: Authorizing `identity:get_user(user_id=78b43c468c5d41459338a471a5c9280f)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:03.382202 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289a8f57-00bb-4f36-bdbd-d02dd31016db None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:03.383597 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 100/196] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:03 2022] GET /identity/v3/users/78b43c468c5d41459338a471a5c9280f => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:03.384576 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a8f57-00bb-4f36-bdbd-d02dd31016db None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:03.492733 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e80cb7-a8dd-4b29-b209-8a1f976f73c1 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:03.538206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289a8f57-00bb-4f36-bdbd-d02dd31016db None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:03.546318 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716afbb8-5245-437c-9d4e-954c5aa7152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:03.547002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716afbb8-5245-437c-9d4e-954c5aa7152c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:03.547285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716afbb8-5245-437c-9d4e-954c5aa7152c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:03.547562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716afbb8-5245-437c-9d4e-954c5aa7152c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:03.595702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:03.608110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ab07f-7341-4be8-89a9-36ff08c29bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:03.609004 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ab07f-7341-4be8-89a9-36ff08c29bf4 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:03.609340 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ab07f-7341-4be8-89a9-36ff08c29bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:03.610453 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ab07f-7341-4be8-89a9-36ff08c29bf4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:03.629266 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ab07f-7341-4be8-89a9-36ff08c29bf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-579ab07f-7341-4be8-89a9-36ff08c29bf4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:03.643962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:03.646100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 101/197] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:03.649385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ab07f-7341-4be8-89a9-36ff08c29bf4 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:03.671128 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716afbb8-5245-437c-9d4e-954c5aa7152c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:03.672691 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716afbb8-5245-437c-9d4e-954c5aa7152c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:03.709685 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:03.853257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ab07f-7341-4be8-89a9-36ff08c29bf4 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:03.874167 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 97/198] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:03.875677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716afbb8-5245-437c-9d4e-954c5aa7152c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:03.920711 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb5c8-bf3a-478f-a3b8-22c682451050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:03.921832 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb5c8-bf3a-478f-a3b8-22c682451050 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:03.922315 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb5c8-bf3a-478f-a3b8-22c682451050 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:03.922783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38bb5c8-bf3a-478f-a3b8-22c682451050 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:04.006971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:04.057686 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bb5c8-bf3a-478f-a3b8-22c682451050 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:04.060497 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38bb5c8-bf3a-478f-a3b8-22c682451050 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:04.084310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716afbb8-5245-437c-9d4e-954c5aa7152c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:04.126414 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:04.152425 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683f7e-1d9d-455a-80df-21ba158a3fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:04.153563 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683f7e-1d9d-455a-80df-21ba158a3fc9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:04.154028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683f7e-1d9d-455a-80df-21ba158a3fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:04.154475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4683f7e-1d9d-455a-80df-21ba158a3fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:04.155911 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4683f7e-1d9d-455a-80df-21ba158a3fc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:04.156455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4683f7e-1d9d-455a-80df-21ba158a3fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:04.158987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4683f7e-1d9d-455a-80df-21ba158a3fc9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:04.174861 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 98/199] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:04.176350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683f7e-1d9d-455a-80df-21ba158a3fc9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:04.262370 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 102/200] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:04.263988 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb5c8-bf3a-478f-a3b8-22c682451050 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:04.366473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4683f7e-1d9d-455a-80df-21ba158a3fc9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:04.414980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:04.436765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cdd5d-79eb-4460-8966-c9a070d2f93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:04.438573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cdd5d-79eb-4460-8966-c9a070d2f93c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:04.439275 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cdd5d-79eb-4460-8966-c9a070d2f93c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:04.439940 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98cdd5d-79eb-4460-8966-c9a070d2f93c None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:04.442277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cdd5d-79eb-4460-8966-c9a070d2f93c None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:04.445272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98cdd5d-79eb-4460-8966-c9a070d2f93c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:04.448638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 99/201] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:04 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:04.450411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cdd5d-79eb-4460-8966-c9a070d2f93c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:04.452624 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38bb5c8-bf3a-478f-a3b8-22c682451050 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:04.539460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1b920-1b14-42b5-ac70-367c59832045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:04.542446 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1b920-1b14-42b5-ac70-367c59832045 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:04.543286 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1b920-1b14-42b5-ac70-367c59832045 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:04.544381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1b920-1b14-42b5-ac70-367c59832045 None admin] PATH_INFO: `/v3/users/bcf87e6e0dbc4c99a65ef1cf4c43f4ac` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:04.547261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1b920-1b14-42b5-ac70-367c59832045 None admin] RBAC: Authorizing `identity:get_user(user_id=bcf87e6e0dbc4c99a65ef1cf4c43f4ac)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:04.550776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae1b920-1b14-42b5-ac70-367c59832045 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:04.555097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 103/202] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:04 2022] GET /identity/v3/users/bcf87e6e0dbc4c99a65ef1cf4c43f4ac => generated 289 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:04.557106 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1b920-1b14-42b5-ac70-367c59832045 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:04.568263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:04.662725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98cdd5d-79eb-4460-8966-c9a070d2f93c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:04.741920 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de022667-15df-4805-8f49-1092cf0058de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:04.743511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de022667-15df-4805-8f49-1092cf0058de None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:04.744047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de022667-15df-4805-8f49-1092cf0058de None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:04.744547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de022667-15df-4805-8f49-1092cf0058de None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:04.746888 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de022667-15df-4805-8f49-1092cf0058de None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:04.750996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de022667-15df-4805-8f49-1092cf0058de None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:04.754560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 100/203] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:04 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:04.756005 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de022667-15df-4805-8f49-1092cf0058de None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:04.792604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae1b920-1b14-42b5-ac70-367c59832045 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:04.862037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad74ca-1ab9-42dd-af81-e6ed2110ee59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:04.863243 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad74ca-1ab9-42dd-af81-e6ed2110ee59 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:04.863692 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad74ca-1ab9-42dd-af81-e6ed2110ee59 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:04.864152 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad74ca-1ab9-42dd-af81-e6ed2110ee59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:04.866681 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad74ca-1ab9-42dd-af81-e6ed2110ee59 None admin] RBAC: Adding query filter params (role.id=f315b062be7e445fa9461a116f9c46ee, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5, user.id=78b43c468c5d41459338a471a5c9280f) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:04.867182 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad74ca-1ab9-42dd-af81-e6ed2110ee59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:04.870718 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ad74ca-1ab9-42dd-af81-e6ed2110ee59 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:04.871954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:04.883862 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 104/204] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:04 2022] GET /identity/v3/role_assignments?user.id=78b43c468c5d41459338a471a5c9280f&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=f315b062be7e445fa9461a116f9c46ee => generated 259 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:04.885471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad74ca-1ab9-42dd-af81-e6ed2110ee59 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:05.004095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de022667-15df-4805-8f49-1092cf0058de None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:05.069867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21430af3-a187-48d7-b173-5939bd7e3708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:05.070921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430af3-a187-48d7-b173-5939bd7e3708 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:05.071362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430af3-a187-48d7-b173-5939bd7e3708 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:05.071783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21430af3-a187-48d7-b173-5939bd7e3708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:05.101737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:05.223965 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad74ca-1ab9-42dd-af81-e6ed2110ee59 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:05.285006 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c57b3-7024-4168-a51d-9677b45ad7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:05.288463 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c57b3-7024-4168-a51d-9677b45ad7f4 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:05.288463 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c57b3-7024-4168-a51d-9677b45ad7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:05.288463 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c57b3-7024-4168-a51d-9677b45ad7f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:05.289055 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c57b3-7024-4168-a51d-9677b45ad7f4 None admin] RBAC: Adding query filter params (role.id=293f9e8d2aba452aadef740529c3d498, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5, user.id=78b43c468c5d41459338a471a5c9280f) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:05.289455 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c57b3-7024-4168-a51d-9677b45ad7f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:05.296477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c57b3-7024-4168-a51d-9677b45ad7f4 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:05.305452 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 105/205] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:04 2022] GET /identity/v3/role_assignments?user.id=78b43c468c5d41459338a471a5c9280f&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=293f9e8d2aba452aadef740529c3d498 => generated 259 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:05.326527 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21430af3-a187-48d7-b173-5939bd7e3708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:05.330740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21430af3-a187-48d7-b173-5939bd7e3708 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:05.489630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:05.575465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 101/206] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 820 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:05.584263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c57b3-7024-4168-a51d-9677b45ad7f4 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:05.796369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c57b3-7024-4168-a51d-9677b45ad7f4 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:05.880776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:05.894013 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28d481a-d6ae-463b-a934-0edeeb5ac279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:05.896376 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d481a-d6ae-463b-a934-0edeeb5ac279 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:05.896891 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d481a-d6ae-463b-a934-0edeeb5ac279 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:05.897365 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28d481a-d6ae-463b-a934-0edeeb5ac279 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:05.906155 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d481a-d6ae-463b-a934-0edeeb5ac279 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:05.908836 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28d481a-d6ae-463b-a934-0edeeb5ac279 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:05.912827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 106/207] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:05 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:05.920995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21430af3-a187-48d7-b173-5939bd7e3708 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:06.137655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21430af3-a187-48d7-b173-5939bd7e3708 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:06.226526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43132ad4-9d91-48ee-a251-94a7c4848fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:06.227624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43132ad4-9d91-48ee-a251-94a7c4848fa0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.228076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43132ad4-9d91-48ee-a251-94a7c4848fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.228572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43132ad4-9d91-48ee-a251-94a7c4848fa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.230869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43132ad4-9d91-48ee-a251-94a7c4848fa0 None admin] RBAC: Adding query filter params (role.id=475524a4f2b44b66a7c5935c0ded858e, scope.project.id=2614591ccb4e488ba922d8212cdc54ee, user.id=bcf87e6e0dbc4c99a65ef1cf4c43f4ac) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:06.231415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43132ad4-9d91-48ee-a251-94a7c4848fa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:06.234356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43132ad4-9d91-48ee-a251-94a7c4848fa0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:06.253336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 102/208] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:05 2022] GET /identity/v3/role_assignments?user.id=bcf87e6e0dbc4c99a65ef1cf4c43f4ac&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=475524a4f2b44b66a7c5935c0ded858e => generated 608 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:06.502701 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af204320-acc9-4161-824c-a4e49e4a4389 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.503206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af204320-acc9-4161-824c-a4e49e4a4389 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.503644 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af204320-acc9-4161-824c-a4e49e4a4389 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.514029 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 107/209] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:06 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:06.531615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63cca6-eed1-44ee-a5ea-a175d7ee6524 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.532667 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63cca6-eed1-44ee-a5ea-a175d7ee6524 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.532667 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f63cca6-eed1-44ee-a5ea-a175d7ee6524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.573756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-4f63cca6-eed1-44ee-a5ea-a175d7ee6524 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:06.575629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-4f63cca6-eed1-44ee-a5ea-a175d7ee6524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:06.626901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:06.763570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 103/210] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:06.809281 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af204320-acc9-4161-824c-a4e49e4a4389 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:06.906041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f341-8fab-4303-b468-1f4807786d93 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.906322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f341-8fab-4303-b468-1f4807786d93 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.906611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1f341-8fab-4303-b468-1f4807786d93 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.908518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 104/211] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:06.914560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105c931-e5d2-4875-a6e5-3ca2441123de None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:06.914969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105c931-e5d2-4875-a6e5-3ca2441123de None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:06.915115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105c931-e5d2-4875-a6e5-3ca2441123de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:06.939431 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-2105c931-e5d2-4875-a6e5-3ca2441123de None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:06.940830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-2105c931-e5d2-4875-a6e5-3ca2441123de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:07.032764 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af204320-acc9-4161-824c-a4e49e4a4389 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:07.046807 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 105/212] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:07.075401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105c931-e5d2-4875-a6e5-3ca2441123de None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:07.096627 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f8c93-24e0-4f79-88f2-4ddcd57ed9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:07.100152 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f8c93-24e0-4f79-88f2-4ddcd57ed9f2 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:07.100152 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f8c93-24e0-4f79-88f2-4ddcd57ed9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:07.100152 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f8c93-24e0-4f79-88f2-4ddcd57ed9f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:07.100594 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f8c93-24e0-4f79-88f2-4ddcd57ed9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:07.102035 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f8c93-24e0-4f79-88f2-4ddcd57ed9f2 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:07.108471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 108/213] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:07.111356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f8c93-24e0-4f79-88f2-4ddcd57ed9f2 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:07.210900 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:07.265253 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:07.270642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f8c93-24e0-4f79-88f2-4ddcd57ed9f2 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:07.294552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105c931-e5d2-4875-a6e5-3ca2441123de None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:07.343796 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af880d-3d79-419e-b665-91e4c224522d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:07.345521 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af880d-3d79-419e-b665-91e4c224522d None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:07.346183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af880d-3d79-419e-b665-91e4c224522d None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:07.346712 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af880d-3d79-419e-b665-91e4c224522d None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:07.347520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c47d78-66e7-489a-a3bf-310b046ed477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:07.348178 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af880d-3d79-419e-b665-91e4c224522d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:07.348777 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c47d78-66e7-489a-a3bf-310b046ed477 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:07.349207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c47d78-66e7-489a-a3bf-310b046ed477 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:07.349635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c47d78-66e7-489a-a3bf-310b046ed477 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:07.351169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af880d-3d79-419e-b665-91e4c224522d None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:07.364159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c47d78-66e7-489a-a3bf-310b046ed477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-71c47d78-66e7-489a-a3bf-310b046ed477 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:07.374935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:07.375997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:07.376902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:07.384270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 106/214] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:07.385697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c47d78-66e7-489a-a3bf-310b046ed477 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:07.400478 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 109/215] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:07 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:35:07.606742 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c47d78-66e7-489a-a3bf-310b046ed477 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:07.675446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbdcc6-5d6e-4123-ad72-3ebbed1bf518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:07.676374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbdcc6-5d6e-4123-ad72-3ebbed1bf518 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:07.676843 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbdcc6-5d6e-4123-ad72-3ebbed1bf518 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:07.677219 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbdcc6-5d6e-4123-ad72-3ebbed1bf518 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:07.678361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbdcc6-5d6e-4123-ad72-3ebbed1bf518 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:07.678772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbdcc6-5d6e-4123-ad72-3ebbed1bf518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:07.680862 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbdcc6-5d6e-4123-ad72-3ebbed1bf518 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:07.695734 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 107/216] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:07.703209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af880d-3d79-419e-b665-91e4c224522d None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:07.845568 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af880d-3d79-419e-b665-91e4c224522d None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:07.900766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:07.925609 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7917d-540a-415f-823c-bf9c13a45f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:07.927710 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7917d-540a-415f-823c-bf9c13a45f07 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:07.928627 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7917d-540a-415f-823c-bf9c13a45f07 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:07.929125 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7917d-540a-415f-823c-bf9c13a45f07 None admin] PATH_INFO: `/v3/users/1dd30e43c53e40ff89300539e3c413aa` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:07.959242 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7917d-540a-415f-823c-bf9c13a45f07 None admin] RBAC: Authorizing `identity:get_user(user_id=1dd30e43c53e40ff89300539e3c413aa)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:07.962160 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7917d-540a-415f-823c-bf9c13a45f07 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:07.965914 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 110/217] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:07 2022] GET /identity/v3/users/1dd30e43c53e40ff89300539e3c413aa => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:07.977204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbdcc6-5d6e-4123-ad72-3ebbed1bf518 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:07.997592 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:08.211014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbdcc6-5d6e-4123-ad72-3ebbed1bf518 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:08.303877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cd9f-03d2-4dfd-8653-75cda3bf699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:08.304932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cd9f-03d2-4dfd-8653-75cda3bf699c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:08.305374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cd9f-03d2-4dfd-8653-75cda3bf699c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:08.305783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07cd9f-03d2-4dfd-8653-75cda3bf699c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:08.472339 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07cd9f-03d2-4dfd-8653-75cda3bf699c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:08.474685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f07cd9f-03d2-4dfd-8653-75cda3bf699c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:08.494110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:08.544704 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0cc67-c499-4145-8135-c748d3765145 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:08.545212 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0cc67-c499-4145-8135-c748d3765145 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:08.545709 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e0cc67-c499-4145-8135-c748d3765145 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:08.548662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 111/218] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:08.555662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf5bb0-731e-4081-9ab5-6d0c39fd7b3d None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:08.556043 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf5bb0-731e-4081-9ab5-6d0c39fd7b3d None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:08.556529 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf5bb0-731e-4081-9ab5-6d0c39fd7b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:08.614241 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-22bf5bb0-731e-4081-9ab5-6d0c39fd7b3d None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:08.616240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-22bf5bb0-731e-4081-9ab5-6d0c39fd7b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:08.711588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 108/219] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:08.719960 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cd9f-03d2-4dfd-8653-75cda3bf699c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:08.902380 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 112/220] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:08.937722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f07cd9f-03d2-4dfd-8653-75cda3bf699c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:08.941162 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf5bb0-731e-4081-9ab5-6d0c39fd7b3d None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:08.955347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:09.037962 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f077a03-ff03-4724-9332-a5f71c99f62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:09.039267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f077a03-ff03-4724-9332-a5f71c99f62b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:09.039749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f077a03-ff03-4724-9332-a5f71c99f62b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:09.040218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f077a03-ff03-4724-9332-a5f71c99f62b None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:09.041857 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f077a03-ff03-4724-9332-a5f71c99f62b None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:09.043826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f077a03-ff03-4724-9332-a5f71c99f62b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:09.046353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 109/221] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:08 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:09.052134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f077a03-ff03-4724-9332-a5f71c99f62b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:09.189612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf5bb0-731e-4081-9ab5-6d0c39fd7b3d None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:09.233951 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:09.262047 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6578e5-6697-441e-8c9e-96bf09de1328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:09.263925 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6578e5-6697-441e-8c9e-96bf09de1328 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:09.265020 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6578e5-6697-441e-8c9e-96bf09de1328 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:09.265830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6578e5-6697-441e-8c9e-96bf09de1328 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:09.288070 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6578e5-6697-441e-8c9e-96bf09de1328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-df6578e5-6697-441e-8c9e-96bf09de1328 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:09.305557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:09.307440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:09.309084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:09.315591 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 113/222] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:09.321732 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6578e5-6697-441e-8c9e-96bf09de1328 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:09.389740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f077a03-ff03-4724-9332-a5f71c99f62b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:09.469709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f787f66-8412-4b71-ba7b-a09a2e0ae1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:09.470926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787f66-8412-4b71-ba7b-a09a2e0ae1ca None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:09.471463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787f66-8412-4b71-ba7b-a09a2e0ae1ca None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:09.471942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f787f66-8412-4b71-ba7b-a09a2e0ae1ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:09.475040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f787f66-8412-4b71-ba7b-a09a2e0ae1ca None admin] RBAC: Adding query filter params (role.id=52b41e61eb19402aa67a7defc45d7f5f, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5, user.id=1dd30e43c53e40ff89300539e3c413aa) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:09.475816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f787f66-8412-4b71-ba7b-a09a2e0ae1ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:09.477711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f787f66-8412-4b71-ba7b-a09a2e0ae1ca None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:09.496097 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 110/223] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:09 2022] GET /identity/v3/role_assignments?user.id=1dd30e43c53e40ff89300539e3c413aa&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 259 bytes in 444 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:09.531275 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6578e5-6697-441e-8c9e-96bf09de1328 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:09.567343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b6e00-3e90-4155-aebb-34d4d85b4667 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:09.567712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b6e00-3e90-4155-aebb-34d4d85b4667 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:09.567998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b6e00-3e90-4155-aebb-34d4d85b4667 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:09.571327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 111/224] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:09.575225 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415732c-e240-4aed-a680-f5740be883ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:09.575921 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415732c-e240-4aed-a680-f5740be883ed None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:09.576093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0a84-8dac-4702-a643-28e7b0368f35 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:09.576343 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415732c-e240-4aed-a680-f5740be883ed None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:09.576484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0a84-8dac-4702-a643-28e7b0368f35 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:09.576681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae0a84-8dac-4702-a643-28e7b0368f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:09.576849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6415732c-e240-4aed-a680-f5740be883ed None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:09.577591 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415732c-e240-4aed-a680-f5740be883ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:09.577905 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415732c-e240-4aed-a680-f5740be883ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:09.579436 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6415732c-e240-4aed-a680-f5740be883ed None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:09.589024 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 114/225] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:09.595361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-03ae0a84-8dac-4702-a643-28e7b0368f35 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:09.596679 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-03ae0a84-8dac-4702-a643-28e7b0368f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:09.600016 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415732c-e240-4aed-a680-f5740be883ed None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:09.644797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:09.677068 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:09.721600 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 112/226] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:09.745133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae0a84-8dac-4702-a643-28e7b0368f35 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:09.811270 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6415732c-e240-4aed-a680-f5740be883ed None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:09.877127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e24bc-46d7-4383-98e7-35f7133b43a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:09.878136 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e24bc-46d7-4383-98e7-35f7133b43a0 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:09.878428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e24bc-46d7-4383-98e7-35f7133b43a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:09.878694 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e24bc-46d7-4383-98e7-35f7133b43a0 None admin] PATH_INFO: `/v3/users/78b43c468c5d41459338a471a5c9280f` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:09.885369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e24bc-46d7-4383-98e7-35f7133b43a0 None admin] RBAC: Authorizing `identity:get_user(user_id=78b43c468c5d41459338a471a5c9280f)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:09.886868 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e24bc-46d7-4383-98e7-35f7133b43a0 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:09.893733 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 115/227] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:09 2022] GET /identity/v3/users/78b43c468c5d41459338a471a5c9280f => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:09.895709 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e24bc-46d7-4383-98e7-35f7133b43a0 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:09.916506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae0a84-8dac-4702-a643-28e7b0368f35 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:09.957270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6c136-b3d3-41c7-99fb-5fe33c96421c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:09.958207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6c136-b3d3-41c7-99fb-5fe33c96421c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:09.958499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6c136-b3d3-41c7-99fb-5fe33c96421c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:09.958777 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c6c136-b3d3-41c7-99fb-5fe33c96421c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:09.974480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c6c136-b3d3-41c7-99fb-5fe33c96421c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-77c6c136-b3d3-41c7-99fb-5fe33c96421c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:09.984324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:09.985287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:09.986055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 113/228] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:09.992421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6c136-b3d3-41c7-99fb-5fe33c96421c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:10.047888 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:10.079686 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e24bc-46d7-4383-98e7-35f7133b43a0 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:10.082095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:10.145853 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ba7ae-a7f0-40a9-ab78-d4e348893c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:10.147003 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba7ae-a7f0-40a9-ab78-d4e348893c97 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.147493 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba7ae-a7f0-40a9-ab78-d4e348893c97 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.147775 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ba7ae-a7f0-40a9-ab78-d4e348893c97 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.153311 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ba7ae-a7f0-40a9-ab78-d4e348893c97 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:10.154830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ba7ae-a7f0-40a9-ab78-d4e348893c97 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:10.157503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 116/229] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:09 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:10.163808 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ba7ae-a7f0-40a9-ab78-d4e348893c97 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:10.217359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c6c136-b3d3-41c7-99fb-5fe33c96421c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:10.291137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40507a8-4e78-4ada-9077-a95142f328e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:10.294106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40507a8-4e78-4ada-9077-a95142f328e7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.294896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40507a8-4e78-4ada-9077-a95142f328e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.299006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40507a8-4e78-4ada-9077-a95142f328e7 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.300141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40507a8-4e78-4ada-9077-a95142f328e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:10.300709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40507a8-4e78-4ada-9077-a95142f328e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:10.302528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40507a8-4e78-4ada-9077-a95142f328e7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:10.319824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 114/230] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:10.326060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40507a8-4e78-4ada-9077-a95142f328e7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:10.443762 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ba7ae-a7f0-40a9-ab78-d4e348893c97 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:10.514316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e93237-c1ed-4140-980f-9fa7b2b506e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:10.515818 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e93237-c1ed-4140-980f-9fa7b2b506e1 None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.519489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e93237-c1ed-4140-980f-9fa7b2b506e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.519489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e93237-c1ed-4140-980f-9fa7b2b506e1 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/users/78b43c468c5d41459338a471a5c9280f/roles/f315b062be7e445fa9461a116f9c46ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.525434 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e93237-c1ed-4140-980f-9fa7b2b506e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1edf83a1ef145608eee0bc79557f6e5, user_id=78b43c468c5d41459338a471a5c9280f, role_id=f315b062be7e445fa9461a116f9c46ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:10.527301 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e93237-c1ed-4140-980f-9fa7b2b506e1 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:10.561852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 117/231] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:10 2022] PUT /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/users/78b43c468c5d41459338a471a5c9280f/roles/f315b062be7e445fa9461a116f9c46ee => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:10.592529 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:10.608515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40507a8-4e78-4ada-9077-a95142f328e7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:10.694840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951e85ab-1314-458b-8ff7-e373fec19fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:10.696901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e85ab-1314-458b-8ff7-e373fec19fb5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.697734 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e85ab-1314-458b-8ff7-e373fec19fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.698596 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951e85ab-1314-458b-8ff7-e373fec19fb5 None admin] PATH_INFO: `/v3/users/78b43c468c5d41459338a471a5c9280f` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.701427 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e85ab-1314-458b-8ff7-e373fec19fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=78b43c468c5d41459338a471a5c9280f)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:10.708465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951e85ab-1314-458b-8ff7-e373fec19fb5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:10.712556 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 115/232] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:10 2022] GET /identity/v3/users/78b43c468c5d41459338a471a5c9280f => generated 283 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:10.719229 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e93237-c1ed-4140-980f-9fa7b2b506e1 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:10.780042 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:10.878390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e93237-c1ed-4140-980f-9fa7b2b506e1 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:10.921234 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33214185-005a-4b62-b173-2b78d90a34ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:10.922608 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33214185-005a-4b62-b173-2b78d90a34ac None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.923091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33214185-005a-4b62-b173-2b78d90a34ac None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.923561 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33214185-005a-4b62-b173-2b78d90a34ac None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.925201 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33214185-005a-4b62-b173-2b78d90a34ac None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:10.927049 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33214185-005a-4b62-b173-2b78d90a34ac None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:10.929607 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 118/233] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:10 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:10.936136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730740b-18e6-4777-8f5c-d8d35689e802 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.937209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730740b-18e6-4777-8f5c-d8d35689e802 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.937534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730740b-18e6-4777-8f5c-d8d35689e802 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.938964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 116/234] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:10.939975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33214185-005a-4b62-b173-2b78d90a34ac None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:10.945554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c2fa7-82f9-4c6a-999a-6231f7698f32 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:10.946426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c2fa7-82f9-4c6a-999a-6231f7698f32 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:10.947144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c2fa7-82f9-4c6a-999a-6231f7698f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:10.974486 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a14c2fa7-82f9-4c6a-999a-6231f7698f32 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:10.976736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a14c2fa7-82f9-4c6a-999a-6231f7698f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:11.071020 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:11.071712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 117/235] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:11.080725 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33214185-005a-4b62-b173-2b78d90a34ac None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:11.097972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c2fa7-82f9-4c6a-999a-6231f7698f32 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:11.125259 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544e8da-2d49-4916-9b30-089a6d693c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:11.126795 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e8da-2d49-4916-9b30-089a6d693c43 None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.127217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e8da-2d49-4916-9b30-089a6d693c43 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.127621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544e8da-2d49-4916-9b30-089a6d693c43 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/users/78b43c468c5d41459338a471a5c9280f/roles/293f9e8d2aba452aadef740529c3d498` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.133868 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544e8da-2d49-4916-9b30-089a6d693c43 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1edf83a1ef145608eee0bc79557f6e5, user_id=78b43c468c5d41459338a471a5c9280f, role_id=293f9e8d2aba452aadef740529c3d498)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:11.135394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544e8da-2d49-4916-9b30-089a6d693c43 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:11.155122 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 119/236] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:10 2022] PUT /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/users/78b43c468c5d41459338a471a5c9280f/roles/293f9e8d2aba452aadef740529c3d498 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:11.265262 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172218ae-dc18-48d1-b874-17012491d10b None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.265796 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:11.266168 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172218ae-dc18-48d1-b874-17012491d10b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.266990 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172218ae-dc18-48d1-b874-17012491d10b None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.268557 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 120/237] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:11.274771 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fcb3e-9bb7-4f45-a09b-1bd9b14ae8d7 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.275419 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fcb3e-9bb7-4f45-a09b-1bd9b14ae8d7 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.275988 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fcb3e-9bb7-4f45-a09b-1bd9b14ae8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.306262 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c2fa7-82f9-4c6a-999a-6231f7698f32 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:11.306662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-063fcb3e-9bb7-4f45-a09b-1bd9b14ae8d7 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:11.308599 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-063fcb3e-9bb7-4f45-a09b-1bd9b14ae8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:11.411314 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 121/238] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:11.412700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd54cf7-bcbd-453c-bafb-042275994a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:11.413726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd54cf7-bcbd-453c-bafb-042275994a2d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.414136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd54cf7-bcbd-453c-bafb-042275994a2d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.414536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd54cf7-bcbd-453c-bafb-042275994a2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.440599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd54cf7-bcbd-453c-bafb-042275994a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:11.444056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fcb3e-9bb7-4f45-a09b-1bd9b14ae8d7 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-9cd54cf7-bcbd-453c-bafb-042275994a2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:11.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:11.450598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:11.451471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 118/239] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:11.462880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd54cf7-bcbd-453c-bafb-042275994a2d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:11.660874 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:11.692556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fcb3e-9bb7-4f45-a09b-1bd9b14ae8d7 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:11.694811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd54cf7-bcbd-453c-bafb-042275994a2d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:11.769198 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef2552-899f-4fe4-be27-85d7893d737f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:11.771607 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef2552-899f-4fe4-be27-85d7893d737f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.772781 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef2552-899f-4fe4-be27-85d7893d737f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.773677 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef2552-899f-4fe4-be27-85d7893d737f None admin] PATH_INFO: `/v3/domains/default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.776516 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef2552-899f-4fe4-be27-85d7893d737f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:11.779295 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef2552-899f-4fe4-be27-85d7893d737f None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:11.782161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 122/240] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:11.784986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec10ba5-9522-4982-9a25-0c3dacb253c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:11.785913 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec10ba5-9522-4982-9a25-0c3dacb253c9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.786342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec10ba5-9522-4982-9a25-0c3dacb253c9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.786747 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec10ba5-9522-4982-9a25-0c3dacb253c9 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.787685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec10ba5-9522-4982-9a25-0c3dacb253c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:11.788783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef2552-899f-4fe4-be27-85d7893d737f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:11.789665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec10ba5-9522-4982-9a25-0c3dacb253c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:11.791702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec10ba5-9522-4982-9a25-0c3dacb253c9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:11.818726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 119/241] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:11.829558 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec10ba5-9522-4982-9a25-0c3dacb253c9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:11.857979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:11.945899 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef2552-899f-4fe4-be27-85d7893d737f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:11.990479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286e2e1-390c-4505-b050-18f7eab04e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:11.991198 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286e2e1-390c-4505-b050-18f7eab04e8c None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:11.991471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286e2e1-390c-4505-b050-18f7eab04e8c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:11.991748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286e2e1-390c-4505-b050-18f7eab04e8c None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:11.992527 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286e2e1-390c-4505-b050-18f7eab04e8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:11.994086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286e2e1-390c-4505-b050-18f7eab04e8c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:12.034164 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 123/242] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:11 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:12.046844 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec10ba5-9522-4982-9a25-0c3dacb253c9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:12.091739 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f45730-27e5-408b-adaa-b83501dd4211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:12.092800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f45730-27e5-408b-adaa-b83501dd4211 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:12.093088 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f45730-27e5-408b-adaa-b83501dd4211 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:12.093370 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f45730-27e5-408b-adaa-b83501dd4211 None admin] PATH_INFO: `/v3/users/84491f7691f1402a9fcfe2babb109eb0` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:12.110985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f45730-27e5-408b-adaa-b83501dd4211 None admin] RBAC: Authorizing `identity:get_user(user_id=84491f7691f1402a9fcfe2babb109eb0)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:12.112656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f45730-27e5-408b-adaa-b83501dd4211 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:12.114887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 120/243] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:11 2022] GET /identity/v3/users/84491f7691f1402a9fcfe2babb109eb0 => generated 297 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:12.121898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286e2e1-390c-4505-b050-18f7eab04e8c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:12.151410 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:12.296000 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286e2e1-390c-4505-b050-18f7eab04e8c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:12.363545 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c50a587-fcbb-4db1-b40e-ca78a158ca71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:12.364227 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a587-fcbb-4db1-b40e-ca78a158ca71 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:12.364544 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a587-fcbb-4db1-b40e-ca78a158ca71 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:12.364824 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c50a587-fcbb-4db1-b40e-ca78a158ca71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:12.460725 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50a587-fcbb-4db1-b40e-ca78a158ca71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:12.462226 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c50a587-fcbb-4db1-b40e-ca78a158ca71 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:12.483757 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:12.606337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 124/244] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:12.612635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f45730-27e5-408b-adaa-b83501dd4211 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:12.678949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1740-161c-435f-9802-94ff2893f972 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:12.679294 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1740-161c-435f-9802-94ff2893f972 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:12.679506 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb1740-161c-435f-9802-94ff2893f972 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:12.681209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 125/245] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:12.694184 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b008-729f-4753-9b1d-1765d658f926 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:12.695116 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b008-729f-4753-9b1d-1765d658f926 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:12.695843 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65b008-729f-4753-9b1d-1765d658f926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:12.699747 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:12.726855 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-dd65b008-729f-4753-9b1d-1765d658f926 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:12.729333 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-dd65b008-729f-4753-9b1d-1765d658f926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:12.740019 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f45730-27e5-408b-adaa-b83501dd4211 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:12.784512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b225629-81ff-4d2a-96f2-62e0ff578adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:12.785709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b225629-81ff-4d2a-96f2-62e0ff578adb None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:12.786126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b225629-81ff-4d2a-96f2-62e0ff578adb None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:12.786537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b225629-81ff-4d2a-96f2-62e0ff578adb None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:12.788581 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b225629-81ff-4d2a-96f2-62e0ff578adb None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:12.791259 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b225629-81ff-4d2a-96f2-62e0ff578adb None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:12.794137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 121/246] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:12 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:12.801661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b225629-81ff-4d2a-96f2-62e0ff578adb None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:12.833562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 126/247] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:12.861518 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65b008-729f-4753-9b1d-1765d658f926 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:12.923574 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:12.965061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b225629-81ff-4d2a-96f2-62e0ff578adb None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:13.008250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9603def-6f81-481c-9d75-242dd0fa3b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:13.009302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9603def-6f81-481c-9d75-242dd0fa3b36 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:13.010143 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9603def-6f81-481c-9d75-242dd0fa3b36 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:13.010746 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9603def-6f81-481c-9d75-242dd0fa3b36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:13.011819 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9603def-6f81-481c-9d75-242dd0fa3b36 None admin] RBAC: Adding query filter params (role.id=475524a4f2b44b66a7c5935c0ded858e, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5, user.id=84491f7691f1402a9fcfe2babb109eb0) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:13.012326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9603def-6f81-481c-9d75-242dd0fa3b36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:13.014604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9603def-6f81-481c-9d75-242dd0fa3b36 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:13.019327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:13.024244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 122/248] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:12 2022] GET /identity/v3/role_assignments?user.id=84491f7691f1402a9fcfe2babb109eb0&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=475524a4f2b44b66a7c5935c0ded858e => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:13.047422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65b008-729f-4753-9b1d-1765d658f926 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:13.095754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4aa264-679f-4230-84eb-78fa7dd9d456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:13.096781 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aa264-679f-4230-84eb-78fa7dd9d456 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:13.097069 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aa264-679f-4230-84eb-78fa7dd9d456 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:13.097344 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4aa264-679f-4230-84eb-78fa7dd9d456 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:13.115065 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4aa264-679f-4230-84eb-78fa7dd9d456 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-7c4aa264-679f-4230-84eb-78fa7dd9d456 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:13.123783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:13.125237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:13.126021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:13.129809 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 127/249] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:13.135877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9603def-6f81-481c-9d75-242dd0fa3b36 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:13.259359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9603def-6f81-481c-9d75-242dd0fa3b36 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:13.309828 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56056-2d11-4b04-9703-3d5e6dd1934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:13.310518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56056-2d11-4b04-9703-3d5e6dd1934b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:13.310805 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56056-2d11-4b04-9703-3d5e6dd1934b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:13.311080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba56056-2d11-4b04-9703-3d5e6dd1934b None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:13.311842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba56056-2d11-4b04-9703-3d5e6dd1934b None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:13.312149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba56056-2d11-4b04-9703-3d5e6dd1934b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:13.313690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba56056-2d11-4b04-9703-3d5e6dd1934b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:13.329357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 123/250] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:13.335572 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4aa264-679f-4230-84eb-78fa7dd9d456 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:13.474414 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4aa264-679f-4230-84eb-78fa7dd9d456 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:13.475959 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:13.531602 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c43397-fe99-4b2d-abbc-517c1345302a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:13.532540 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c43397-fe99-4b2d-abbc-517c1345302a None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:13.532828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c43397-fe99-4b2d-abbc-517c1345302a None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:13.533104 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c43397-fe99-4b2d-abbc-517c1345302a None admin] PATH_INFO: `/v3/users/1dd30e43c53e40ff89300539e3c413aa` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:13.534347 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c43397-fe99-4b2d-abbc-517c1345302a None admin] RBAC: Authorizing `identity:get_user(user_id=1dd30e43c53e40ff89300539e3c413aa)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:13.535829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c43397-fe99-4b2d-abbc-517c1345302a None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:13.537537 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 128/251] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:13 2022] GET /identity/v3/users/1dd30e43c53e40ff89300539e3c413aa => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:13.543490 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56056-2d11-4b04-9703-3d5e6dd1934b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:13.643044 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:13.693224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba56056-2d11-4b04-9703-3d5e6dd1934b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:13.732215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4366a59-f19b-43f3-8489-e0e60ebaf5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:13.733037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4366a59-f19b-43f3-8489-e0e60ebaf5c2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:13.733456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4366a59-f19b-43f3-8489-e0e60ebaf5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:13.733767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4366a59-f19b-43f3-8489-e0e60ebaf5c2 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:13.734977 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4366a59-f19b-43f3-8489-e0e60ebaf5c2 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:13.736473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4366a59-f19b-43f3-8489-e0e60ebaf5c2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:13.738384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 124/252] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:13 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:13.749596 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c43397-fe99-4b2d-abbc-517c1345302a None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:13.878094 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c43397-fe99-4b2d-abbc-517c1345302a None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:13.920948 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52d226-802d-4361-9582-478c483ef54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:13.921873 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52d226-802d-4361-9582-478c483ef54e None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:13.922161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52d226-802d-4361-9582-478c483ef54e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:13.922439 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52d226-802d-4361-9582-478c483ef54e None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/users/1dd30e43c53e40ff89300539e3c413aa/roles/52b41e61eb19402aa67a7defc45d7f5f` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:13.924518 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52d226-802d-4361-9582-478c483ef54e None admin] RBAC: Authorizing `identity:create_grant(project_id=d1edf83a1ef145608eee0bc79557f6e5, user_id=1dd30e43c53e40ff89300539e3c413aa, role_id=52b41e61eb19402aa67a7defc45d7f5f)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:13.926074 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52d226-802d-4361-9582-478c483ef54e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:13.953759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 129/253] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:13 2022] PUT /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/users/1dd30e43c53e40ff89300539e3c413aa/roles/52b41e61eb19402aa67a7defc45d7f5f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:14.218137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eacef-d49b-4865-8476-8551233127be None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:14.218698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eacef-d49b-4865-8476-8551233127be None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:14.218698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077eacef-d49b-4865-8476-8551233127be None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:14.220079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 125/254] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:14.238695 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9c90a-3447-4438-bf11-d8239b07f092 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:14.239222 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9c90a-3447-4438-bf11-d8239b07f092 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:14.239294 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd9c90a-3447-4438-bf11-d8239b07f092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:14.264189 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-afd9c90a-3447-4438-bf11-d8239b07f092 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:14.265461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-afd9c90a-3447-4438-bf11-d8239b07f092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:14.308087 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:14.377663 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 130/255] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:14.426097 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eacef-d49b-4865-8476-8551233127be None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:14.594124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077eacef-d49b-4865-8476-8551233127be None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:14.633463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:14.639604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186782ba-a63e-4d5b-8bac-faf4b1d5ddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:14.640423 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186782ba-a63e-4d5b-8bac-faf4b1d5ddfe None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:14.640733 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186782ba-a63e-4d5b-8bac-faf4b1d5ddfe None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:14.641015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186782ba-a63e-4d5b-8bac-faf4b1d5ddfe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:14.659896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186782ba-a63e-4d5b-8bac-faf4b1d5ddfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-186782ba-a63e-4d5b-8bac-faf4b1d5ddfe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:14.667997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:14.668957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:14.669720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:14.672209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 126/256] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:14.678045 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9c90a-3447-4438-bf11-d8239b07f092 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:14.839157 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd9c90a-3447-4438-bf11-d8239b07f092 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:14.893811 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4041f-774f-4be9-bb82-c62ac14cd0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:14.894887 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4041f-774f-4be9-bb82-c62ac14cd0a8 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:14.895363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4041f-774f-4be9-bb82-c62ac14cd0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:14.895868 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4041f-774f-4be9-bb82-c62ac14cd0a8 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:14.896858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4041f-774f-4be9-bb82-c62ac14cd0a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:14.897355 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4041f-774f-4be9-bb82-c62ac14cd0a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:14.898942 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4041f-774f-4be9-bb82-c62ac14cd0a8 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:14.913063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 131/257] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:14.918961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186782ba-a63e-4d5b-8bac-faf4b1d5ddfe None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:15.060914 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9854fc-4858-4f31-865e-0315d0761068 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:15.061639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9854fc-4858-4f31-865e-0315d0761068 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:15.062138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9854fc-4858-4f31-865e-0315d0761068 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:15.065237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 132/258] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:15.069028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186782ba-a63e-4d5b-8bac-faf4b1d5ddfe None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:15.070573 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bca3ad-5540-40bd-af50-d3d2192bd643 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:15.071057 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bca3ad-5540-40bd-af50-d3d2192bd643 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:15.071546 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bca3ad-5540-40bd-af50-d3d2192bd643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:15.107525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-71bca3ad-5540-40bd-af50-d3d2192bd643 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:15.109205 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-71bca3ad-5540-40bd-af50-d3d2192bd643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:15.133369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd1bcb-c6c1-4fe3-a9db-9f0d39118473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:15.134369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd1bcb-c6c1-4fe3-a9db-9f0d39118473 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:15.134905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd1bcb-c6c1-4fe3-a9db-9f0d39118473 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:15.135401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd1bcb-c6c1-4fe3-a9db-9f0d39118473 None admin] PATH_INFO: `/v3/users/78b43c468c5d41459338a471a5c9280f` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:15.137291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd1bcb-c6c1-4fe3-a9db-9f0d39118473 None admin] RBAC: Authorizing `identity:get_user(user_id=78b43c468c5d41459338a471a5c9280f)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:15.139182 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd1bcb-c6c1-4fe3-a9db-9f0d39118473 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:15.141680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 127/259] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:14 2022] GET /identity/v3/users/78b43c468c5d41459338a471a5c9280f => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:15.152893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:15.165837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd1bcb-c6c1-4fe3-a9db-9f0d39118473 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:15.243311 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 133/260] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:15.287353 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bca3ad-5540-40bd-af50-d3d2192bd643 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:15.300802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:15.408820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd1bcb-c6c1-4fe3-a9db-9f0d39118473 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:15.475735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e33bb-00ba-49cf-907d-143a19d86a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:15.477192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e33bb-00ba-49cf-907d-143a19d86a1c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:15.477719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e33bb-00ba-49cf-907d-143a19d86a1c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:15.478195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e33bb-00ba-49cf-907d-143a19d86a1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:15.502554 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bca3ad-5540-40bd-af50-d3d2192bd643 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:15.562788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e33bb-00ba-49cf-907d-143a19d86a1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:15.565000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e33bb-00ba-49cf-907d-143a19d86a1c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:15.637497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:15.665360 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69792db-6bae-42eb-a301-43a531cfc01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:15.666185 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69792db-6bae-42eb-a301-43a531cfc01d None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:15.666472 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69792db-6bae-42eb-a301-43a531cfc01d None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:15.666745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69792db-6bae-42eb-a301-43a531cfc01d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:15.682717 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 128/261] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:15.684357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675b18-cfb1-42f2-97ba-0c943cb65cec None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:15.684832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675b18-cfb1-42f2-97ba-0c943cb65cec None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:15.685495 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8675b18-cfb1-42f2-97ba-0c943cb65cec None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:15.687446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 129/262] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:15.694440 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5154263-2998-4abf-ae54-c35026dba2a1 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:15.694949 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5154263-2998-4abf-ae54-c35026dba2a1 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:15.695370 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5154263-2998-4abf-ae54-c35026dba2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:15.713427 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69792db-6bae-42eb-a301-43a531cfc01d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:15.716165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a5154263-2998-4abf-ae54-c35026dba2a1 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:15.717615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a5154263-2998-4abf-ae54-c35026dba2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-a69792db-6bae-42eb-a301-43a531cfc01d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:15.721740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:15.722924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:15.723877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:15.734583 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 134/263] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:15.735703 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69792db-6bae-42eb-a301-43a531cfc01d None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:15.776467 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:15.808580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 130/264] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:15.809766 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5154263-2998-4abf-ae54-c35026dba2a1 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:15.919903 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:15.929193 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5154263-2998-4abf-ae54-c35026dba2a1 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:15.976817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82177ec-e68a-4de4-8fe5-ddf092910db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:15.978034 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82177ec-e68a-4de4-8fe5-ddf092910db3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:15.978599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82177ec-e68a-4de4-8fe5-ddf092910db3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:15.979759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82177ec-e68a-4de4-8fe5-ddf092910db3 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:15.980898 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82177ec-e68a-4de4-8fe5-ddf092910db3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:15.981437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82177ec-e68a-4de4-8fe5-ddf092910db3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:15.983440 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82177ec-e68a-4de4-8fe5-ddf092910db3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:15.995340 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 131/265] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:15.996670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82177ec-e68a-4de4-8fe5-ddf092910db3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:16.117639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69792db-6bae-42eb-a301-43a531cfc01d None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:16.142041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82177ec-e68a-4de4-8fe5-ddf092910db3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:16.165129 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6af8e6-b181-4885-b70f-d08d25a44275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:16.166648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af8e6-b181-4885-b70f-d08d25a44275 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:16.167082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af8e6-b181-4885-b70f-d08d25a44275 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:16.167498 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6af8e6-b181-4885-b70f-d08d25a44275 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:16.168989 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6af8e6-b181-4885-b70f-d08d25a44275 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:16.171506 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6af8e6-b181-4885-b70f-d08d25a44275 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:16.174384 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 135/266] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:15 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:16.175446 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6af8e6-b181-4885-b70f-d08d25a44275 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:16.191508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946173d-f3f7-4855-9849-7427623b28da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:16.192653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946173d-f3f7-4855-9849-7427623b28da None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:16.193072 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946173d-f3f7-4855-9849-7427623b28da None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:16.193594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946173d-f3f7-4855-9849-7427623b28da None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:16.213613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946173d-f3f7-4855-9849-7427623b28da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-d946173d-f3f7-4855-9849-7427623b28da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:16.224644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:16.225771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:16.226658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:16.228781 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 132/267] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:16.231285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28464fb-09e1-4b28-a627-dd6ebaa8cc56 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:16.231732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28464fb-09e1-4b28-a627-dd6ebaa8cc56 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:16.232140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28464fb-09e1-4b28-a627-dd6ebaa8cc56 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:16.234538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 133/268] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:16.235489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28464fb-09e1-4b28-a627-dd6ebaa8cc56 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:16.267172 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:16.298055 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:16.317173 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6af8e6-b181-4885-b70f-d08d25a44275 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:16.373906 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcba947-9581-438a-bb34-05ee000b490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:16.375097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcba947-9581-438a-bb34-05ee000b490b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:16.375385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcba947-9581-438a-bb34-05ee000b490b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:16.375661 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcba947-9581-438a-bb34-05ee000b490b None admin] PATH_INFO: `/v3/users/78b43c468c5d41459338a471a5c9280f` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:16.377395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcba947-9581-438a-bb34-05ee000b490b None admin] RBAC: Authorizing `identity:get_user(user_id=78b43c468c5d41459338a471a5c9280f)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:16.378876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcba947-9581-438a-bb34-05ee000b490b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:16.381172 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 136/269] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:16 2022] GET /identity/v3/users/78b43c468c5d41459338a471a5c9280f => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:16.381978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcba947-9581-438a-bb34-05ee000b490b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:16.402969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28464fb-09e1-4b28-a627-dd6ebaa8cc56 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:16.441344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5258f-88f0-4191-8b53-61bd7cbb2cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:16.442388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5258f-88f0-4191-8b53-61bd7cbb2cd3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:16.442888 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5258f-88f0-4191-8b53-61bd7cbb2cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:16.443357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5258f-88f0-4191-8b53-61bd7cbb2cd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:16.444494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5258f-88f0-4191-8b53-61bd7cbb2cd3 None admin] RBAC: Adding query filter params (role.id=f315b062be7e445fa9461a116f9c46ee, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5, user.id=78b43c468c5d41459338a471a5c9280f) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:16.445030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5258f-88f0-4191-8b53-61bd7cbb2cd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:16.446802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5258f-88f0-4191-8b53-61bd7cbb2cd3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:16.454522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 134/270] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:16 2022] GET /identity/v3/role_assignments?user.id=78b43c468c5d41459338a471a5c9280f&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=f315b062be7e445fa9461a116f9c46ee => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:16.456258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60811d68-bd14-4992-86c2-4ef39b5ab245 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:16.456797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60811d68-bd14-4992-86c2-4ef39b5ab245 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:16.457276 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60811d68-bd14-4992-86c2-4ef39b5ab245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:16.478074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-60811d68-bd14-4992-86c2-4ef39b5ab245 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:16.479777 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-60811d68-bd14-4992-86c2-4ef39b5ab245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:16.532498 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcba947-9581-438a-bb34-05ee000b490b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:16.610517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 135/271] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:16.612360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60811d68-bd14-4992-86c2-4ef39b5ab245 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:16.628025 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:16.629695 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a151be-dfb6-4285-be82-875a7aea3a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:16.630933 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a151be-dfb6-4285-be82-875a7aea3a2c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:16.631391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a151be-dfb6-4285-be82-875a7aea3a2c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:16.632073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a151be-dfb6-4285-be82-875a7aea3a2c None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:16.633257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a151be-dfb6-4285-be82-875a7aea3a2c None admin] RBAC: Adding query filter params (name=member) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:16.633703 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a151be-dfb6-4285-be82-875a7aea3a2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:16.635641 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a151be-dfb6-4285-be82-875a7aea3a2c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:16.667996 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 137/272] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:16.675183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a151be-dfb6-4285-be82-875a7aea3a2c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:16.715936 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:16.855122 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60811d68-bd14-4992-86c2-4ef39b5ab245 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:16.894654 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a151be-dfb6-4285-be82-875a7aea3a2c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:16.921960 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed663d90-2d16-4061-a7d7-2e3ce904cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:16.923102 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed663d90-2d16-4061-a7d7-2e3ce904cf8a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:16.923572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed663d90-2d16-4061-a7d7-2e3ce904cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:16.924035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed663d90-2d16-4061-a7d7-2e3ce904cf8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:16.975338 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a11292-37be-42b5-8ecc-071b5743a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:16.977351 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a11292-37be-42b5-8ecc-071b5743a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:16.977832 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a11292-37be-42b5-8ecc-071b5743a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:16.978291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a11292-37be-42b5-8ecc-071b5743a1a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:16.980653 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a11292-37be-42b5-8ecc-071b5743a1a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:16.984600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a11292-37be-42b5-8ecc-071b5743a1a0 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:16.989078 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 138/273] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:16.990711 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a11292-37be-42b5-8ecc-071b5743a1a0 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:17.078352 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed663d90-2d16-4061-a7d7-2e3ce904cf8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:17.080598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed663d90-2d16-4061-a7d7-2e3ce904cf8a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:17.084807 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:17.139269 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:17.183509 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a11292-37be-42b5-8ecc-071b5743a1a0 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:17.232571 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43687b3c-de70-403d-984e-d00097a0ba4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:17.234539 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43687b3c-de70-403d-984e-d00097a0ba4c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:17.235111 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43687b3c-de70-403d-984e-d00097a0ba4c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:17.235575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43687b3c-de70-403d-984e-d00097a0ba4c None admin] PATH_INFO: `/v3/users/2737a2899c124a7eb59e2b66840c7a81` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:17.253100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 136/274] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:17.253100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a6543-c76c-44d4-a1e6-7b36a589060f None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:17.253100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a6543-c76c-44d4-a1e6-7b36a589060f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:17.253100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a6543-c76c-44d4-a1e6-7b36a589060f None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:17.253100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 137/275] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:17.253100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a6543-c76c-44d4-a1e6-7b36a589060f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:17.265008 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43687b3c-de70-403d-984e-d00097a0ba4c None admin] RBAC: Authorizing `identity:get_user(user_id=2737a2899c124a7eb59e2b66840c7a81)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:17.268112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43687b3c-de70-403d-984e-d00097a0ba4c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:17.271999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 139/276] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:16 2022] GET /identity/v3/users/2737a2899c124a7eb59e2b66840c7a81 => generated 293 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:17.273590 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43687b3c-de70-403d-984e-d00097a0ba4c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:17.393895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a6543-c76c-44d4-a1e6-7b36a589060f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:17.396515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:17.433368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10092b16-224b-45df-98ae-8d5e72fa9028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:17.434083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092b16-224b-45df-98ae-8d5e72fa9028 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:17.434326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092b16-224b-45df-98ae-8d5e72fa9028 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:17.434598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10092b16-224b-45df-98ae-8d5e72fa9028 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:17.435316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10092b16-224b-45df-98ae-8d5e72fa9028 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:17.436841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10092b16-224b-45df-98ae-8d5e72fa9028 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:17.451814 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43687b3c-de70-403d-984e-d00097a0ba4c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:17.464808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 138/277] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:17 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:17.467260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f86c9e-e88e-47b8-b105-3841ce2049f8 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:17.467519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f86c9e-e88e-47b8-b105-3841ce2049f8 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:17.467950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f86c9e-e88e-47b8-b105-3841ce2049f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:17.498693 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1cb73-6ebf-42c6-8689-9482e3abc117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:17.499394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c6f86c9e-e88e-47b8-b105-3841ce2049f8 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:17.499540 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1cb73-6ebf-42c6-8689-9482e3abc117 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:17.499790 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1cb73-6ebf-42c6-8689-9482e3abc117 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:17.500010 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea1cb73-6ebf-42c6-8689-9482e3abc117 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:17.501367 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1cb73-6ebf-42c6-8689-9482e3abc117 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:17.501566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c6f86c9e-e88e-47b8-b105-3841ce2049f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:17.502890 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea1cb73-6ebf-42c6-8689-9482e3abc117 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:17.516095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 140/278] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:17 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:17.516095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1cb73-6ebf-42c6-8689-9482e3abc117 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:17.531297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:17.607940 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 139/279] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:17.609593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a3e7-8a58-4165-a96f-a244a7800249 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:17.609877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a3e7-8a58-4165-a96f-a244a7800249 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:17.610150 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d49a3e7-8a58-4165-a96f-a244a7800249 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:17.616724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 140/280] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:17.617886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49a3e7-8a58-4165-a96f-a244a7800249 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:17.733265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea1cb73-6ebf-42c6-8689-9482e3abc117 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:17.750878 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:17.768188 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d49a3e7-8a58-4165-a96f-a244a7800249 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:17.804315 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521042c-779e-40f1-abd9-1c39bf568880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:17.805030 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521042c-779e-40f1-abd9-1c39bf568880 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:17.805341 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521042c-779e-40f1-abd9-1c39bf568880 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:17.805581 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521042c-779e-40f1-abd9-1c39bf568880 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:17.806494 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521042c-779e-40f1-abd9-1c39bf568880 None admin] RBAC: Adding query filter params (role.id=52b41e61eb19402aa67a7defc45d7f5f, user.id=2737a2899c124a7eb59e2b66840c7a81, scope.system=all) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:17.806890 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521042c-779e-40f1-abd9-1c39bf568880 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:17.809759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521042c-779e-40f1-abd9-1c39bf568880 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:17.816138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 141/281] 10.222.0.24 () {56 vars in 1308 bytes} [Sat Jun 4 20:35:17 2022] GET /identity/v3/role_assignments?user.id=2737a2899c124a7eb59e2b66840c7a81&scope.system=all&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 226 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:17.817503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da9f6-5eff-480b-ad36-dde16fc92811 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:17.817789 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da9f6-5eff-480b-ad36-dde16fc92811 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:17.818781 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6da9f6-5eff-480b-ad36-dde16fc92811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:17.832380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33bec8-7d5e-4f82-9cbd-6f06c29aac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:17.833625 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33bec8-7d5e-4f82-9cbd-6f06c29aac61 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:17.834121 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33bec8-7d5e-4f82-9cbd-6f06c29aac61 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:17.834610 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33bec8-7d5e-4f82-9cbd-6f06c29aac61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:17.836302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33bec8-7d5e-4f82-9cbd-6f06c29aac61 None admin] RBAC: Adding query filter params (role.id=293f9e8d2aba452aadef740529c3d498, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5, user.id=78b43c468c5d41459338a471a5c9280f) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:17.836919 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33bec8-7d5e-4f82-9cbd-6f06c29aac61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:17.840375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33bec8-7d5e-4f82-9cbd-6f06c29aac61 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:17.845856 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-bf6da9f6-5eff-480b-ad36-dde16fc92811 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:17.847511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-bf6da9f6-5eff-480b-ad36-dde16fc92811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:17.858051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 141/282] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:17 2022] GET /identity/v3/role_assignments?user.id=78b43c468c5d41459338a471a5c9280f&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=293f9e8d2aba452aadef740529c3d498 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:17.858051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33bec8-7d5e-4f82-9cbd-6f06c29aac61 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:18.001878 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:18.023196 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 142/283] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:18.076814 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6da9f6-5eff-480b-ad36-dde16fc92811 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:18.115121 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33bec8-7d5e-4f82-9cbd-6f06c29aac61 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:18.182319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1334e-5fbe-40df-afc2-af02f97b359f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:18.183154 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1334e-5fbe-40df-afc2-af02f97b359f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:18.183432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1334e-5fbe-40df-afc2-af02f97b359f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:18.183707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1334e-5fbe-40df-afc2-af02f97b359f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:18.198924 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1334e-5fbe-40df-afc2-af02f97b359f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-0aa1334e-5fbe-40df-afc2-af02f97b359f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:18.208740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:18.210687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:18.212404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 142/284] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:18.225634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1334e-5fbe-40df-afc2-af02f97b359f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:18.261293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:18.326528 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6da9f6-5eff-480b-ad36-dde16fc92811 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:18.403269 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97e39d-a97e-40ae-b991-dcb2a65bdb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:18.404869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97e39d-a97e-40ae-b991-dcb2a65bdb5f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:18.405478 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97e39d-a97e-40ae-b991-dcb2a65bdb5f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:18.406138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97e39d-a97e-40ae-b991-dcb2a65bdb5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:18.427431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e97e39d-a97e-40ae-b991-dcb2a65bdb5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:18.438305 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1334e-5fbe-40df-afc2-af02f97b359f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-8e97e39d-a97e-40ae-b991-dcb2a65bdb5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:18.443997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:18.446204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:18.448252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:18.450935 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 143/285] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:18.458015 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97e39d-a97e-40ae-b991-dcb2a65bdb5f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:18.520630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3bc6f-4bb4-45c5-bd4a-6b15ca343c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:18.522293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3bc6f-4bb4-45c5-bd4a-6b15ca343c04 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:18.523058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3bc6f-4bb4-45c5-bd4a-6b15ca343c04 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:18.523754 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3bc6f-4bb4-45c5-bd4a-6b15ca343c04 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:18.525656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3bc6f-4bb4-45c5-bd4a-6b15ca343c04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:18.526444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3bc6f-4bb4-45c5-bd4a-6b15ca343c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:18.530482 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3bc6f-4bb4-45c5-bd4a-6b15ca343c04 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:18.547872 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 143/286] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:18.559862 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3bc6f-4bb4-45c5-bd4a-6b15ca343c04 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:18.583340 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:18.676060 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97e39d-a97e-40ae-b991-dcb2a65bdb5f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:18.720029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:18.746899 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed0353-997b-4084-9123-cef8e634a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:18.748631 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed0353-997b-4084-9123-cef8e634a496 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:18.749458 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed0353-997b-4084-9123-cef8e634a496 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:18.750232 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ed0353-997b-4084-9123-cef8e634a496 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:18.752010 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed0353-997b-4084-9123-cef8e634a496 None admin] RBAC: Adding query filter params (name=member) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:18.752935 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed0353-997b-4084-9123-cef8e634a496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:18.755919 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ed0353-997b-4084-9123-cef8e634a496 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:18.766965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3bc6f-4bb4-45c5-bd4a-6b15ca343c04 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:18.775057 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 144/287] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:18.786646 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed0353-997b-4084-9123-cef8e634a496 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:18.839806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb4bc0-bb47-4391-9b4f-9894c4a9f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:18.842797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb4bc0-bb47-4391-9b4f-9894c4a9f203 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:18.843160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb4bc0-bb47-4391-9b4f-9894c4a9f203 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:18.843620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffb4bc0-bb47-4391-9b4f-9894c4a9f203 None admin] PATH_INFO: `/v3/users/84491f7691f1402a9fcfe2babb109eb0` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:18.845899 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb4bc0-bb47-4391-9b4f-9894c4a9f203 None admin] RBAC: Authorizing `identity:get_user(user_id=84491f7691f1402a9fcfe2babb109eb0)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:18.848986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffb4bc0-bb47-4391-9b4f-9894c4a9f203 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:18.856876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 144/288] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:18 2022] GET /identity/v3/users/84491f7691f1402a9fcfe2babb109eb0 => generated 297 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:18.862583 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb4bc0-bb47-4391-9b4f-9894c4a9f203 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:19.002804 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ed0353-997b-4084-9123-cef8e634a496 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:19.069762 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:19.116624 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32fd7-7608-41e5-9d5d-e1772babc4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:19.119428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32fd7-7608-41e5-9d5d-e1772babc4cf None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:19.120251 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32fd7-7608-41e5-9d5d-e1772babc4cf None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:19.121050 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b32fd7-7608-41e5-9d5d-e1772babc4cf None admin] PATH_INFO: `/v3/users/1dd30e43c53e40ff89300539e3c413aa` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:19.123657 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b32fd7-7608-41e5-9d5d-e1772babc4cf None admin] RBAC: Authorizing `identity:get_user(user_id=1dd30e43c53e40ff89300539e3c413aa)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:19.127962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b32fd7-7608-41e5-9d5d-e1772babc4cf None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:19.132263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 145/289] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:18 2022] GET /identity/v3/users/1dd30e43c53e40ff89300539e3c413aa => generated 297 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:19.138730 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32fd7-7608-41e5-9d5d-e1772babc4cf None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:19.219622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffb4bc0-bb47-4391-9b4f-9894c4a9f203 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:19.311376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c52a10-9726-4dc7-afdd-6434c97daaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:19.311692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52a10-9726-4dc7-afdd-6434c97daaed None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:19.312049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52a10-9726-4dc7-afdd-6434c97daaed None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:19.312239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c52a10-9726-4dc7-afdd-6434c97daaed None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:19.317220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c52a10-9726-4dc7-afdd-6434c97daaed None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:19.318738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c52a10-9726-4dc7-afdd-6434c97daaed None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:19.321024 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 145/290] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:18 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:19.329839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c52a10-9726-4dc7-afdd-6434c97daaed None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:19.359341 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:19.383355 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b32fd7-7608-41e5-9d5d-e1772babc4cf None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:19.462905 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f802eed-5391-472f-9e06-9493d315a66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:19.465525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f802eed-5391-472f-9e06-9493d315a66c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:19.466520 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f802eed-5391-472f-9e06-9493d315a66c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:19.467374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f802eed-5391-472f-9e06-9493d315a66c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:19.605428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:19.607235 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c52a10-9726-4dc7-afdd-6434c97daaed None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:19.638098 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f802eed-5391-472f-9e06-9493d315a66c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:19.641863 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f802eed-5391-472f-9e06-9493d315a66c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:19.697750 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa9e5f-a7db-46db-8690-945b67a37abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:19.699178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa9e5f-a7db-46db-8690-945b67a37abe None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:19.699646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa9e5f-a7db-46db-8690-945b67a37abe None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:19.700119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa9e5f-a7db-46db-8690-945b67a37abe None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/users/84491f7691f1402a9fcfe2babb109eb0/roles/475524a4f2b44b66a7c5935c0ded858e` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:19.705953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa9e5f-a7db-46db-8690-945b67a37abe None admin] RBAC: Authorizing `identity:create_grant(project_id=d1edf83a1ef145608eee0bc79557f6e5, user_id=84491f7691f1402a9fcfe2babb109eb0, role_id=475524a4f2b44b66a7c5935c0ded858e)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:19.707728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa9e5f-a7db-46db-8690-945b67a37abe None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:19.743242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 146/291] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:35:19 2022] PUT /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/users/84491f7691f1402a9fcfe2babb109eb0/roles/475524a4f2b44b66a7c5935c0ded858e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:35:19.868099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 146/292] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:19.874366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa9e5f-a7db-46db-8690-945b67a37abe None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:20.004634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:20.048834 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa9e5f-a7db-46db-8690-945b67a37abe None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:20.106047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67747c-fa73-4671-a33d-9b14256c8163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:20.106953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67747c-fa73-4671-a33d-9b14256c8163 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.107233 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67747c-fa73-4671-a33d-9b14256c8163 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.107504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67747c-fa73-4671-a33d-9b14256c8163 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.108932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67747c-fa73-4671-a33d-9b14256c8163 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:20.110429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67747c-fa73-4671-a33d-9b14256c8163 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:20.112656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 147/293] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:19 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:20.120684 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f802eed-5391-472f-9e06-9493d315a66c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:20.320880 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:20.346874 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f802eed-5391-472f-9e06-9493d315a66c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:20.413900 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbd9e3-9b3c-43ae-a291-9aeaf01c29d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:20.414965 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbd9e3-9b3c-43ae-a291-9aeaf01c29d7 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.415454 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbd9e3-9b3c-43ae-a291-9aeaf01c29d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.415960 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbd9e3-9b3c-43ae-a291-9aeaf01c29d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.417742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbd9e3-9b3c-43ae-a291-9aeaf01c29d7 None admin] RBAC: Adding query filter params (role.id=52b41e61eb19402aa67a7defc45d7f5f, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5, user.id=1dd30e43c53e40ff89300539e3c413aa) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:20.418307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbd9e3-9b3c-43ae-a291-9aeaf01c29d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:20.421322 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbd9e3-9b3c-43ae-a291-9aeaf01c29d7 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:20.430910 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 147/294] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:20 2022] GET /identity/v3/role_assignments?user.id=1dd30e43c53e40ff89300539e3c413aa&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:20.920360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e01a-21bf-4268-b89e-e055a1c4e58a None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.920360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e01a-21bf-4268-b89e-e055a1c4e58a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.920360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9e01a-21bf-4268-b89e-e055a1c4e58a None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.922548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 148/295] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:20.929785 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eff5a-e1d3-4acd-b123-764c3047871f None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:20.930643 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eff5a-e1d3-4acd-b123-764c3047871f None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:20.931090 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5eff5a-e1d3-4acd-b123-764c3047871f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:20.952371 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-db5eff5a-e1d3-4acd-b123-764c3047871f None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:20.953859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-db5eff5a-e1d3-4acd-b123-764c3047871f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:21.055924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 148/296] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:21.083355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e01a-21bf-4268-b89e-e055a1c4e58a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.236600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd37b6e-c427-4cf5-b32f-7e30d2c8d969 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.237005 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd37b6e-c427-4cf5-b32f-7e30d2c8d969 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.237197 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd37b6e-c427-4cf5-b32f-7e30d2c8d969 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.242784 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 149/297] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:21.244836 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888deb2-694e-4c9d-baf1-b0be3c02daf6 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.245131 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888deb2-694e-4c9d-baf1-b0be3c02daf6 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.245386 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888deb2-694e-4c9d-baf1-b0be3c02daf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.263271 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-5888deb2-694e-4c9d-baf1-b0be3c02daf6 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:21.264494 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-5888deb2-694e-4c9d-baf1-b0be3c02daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:21.288672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9e01a-21bf-4268-b89e-e055a1c4e58a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.333157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d99e3d-398f-4530-8e48-5feb0e2b518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:21.334490 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99e3d-398f-4530-8e48-5feb0e2b518e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.334956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99e3d-398f-4530-8e48-5feb0e2b518e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.335436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d99e3d-398f-4530-8e48-5feb0e2b518e None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.337253 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d99e3d-398f-4530-8e48-5feb0e2b518e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:21.338807 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d99e3d-398f-4530-8e48-5feb0e2b518e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:21.341059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 149/298] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:21.347922 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d99e3d-398f-4530-8e48-5feb0e2b518e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.363325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:21.392690 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 150/299] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:21.419594 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888deb2-694e-4c9d-baf1-b0be3c02daf6 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.449382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:21.481165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d99e3d-398f-4530-8e48-5feb0e2b518e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.530453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8beaa-392e-4e90-991c-027ac7dc95ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:21.531142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8beaa-392e-4e90-991c-027ac7dc95ef None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.531424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8beaa-392e-4e90-991c-027ac7dc95ef None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.531700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8beaa-392e-4e90-991c-027ac7dc95ef None admin] PATH_INFO: `/v3/groups` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.532790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8beaa-392e-4e90-991c-027ac7dc95ef None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:21.533932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8beaa-392e-4e90-991c-027ac7dc95ef None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:21.572570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 150/300] 10.222.0.24 () {60 vars in 1134 bytes} [Sat Jun 4 20:35:21 2022] POST /identity/v3/groups => generated 229 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:21.609602 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888deb2-694e-4c9d-baf1-b0be3c02daf6 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.659499 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e51a3a-9a08-46b0-a615-72d044a774d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:21.660827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e51a3a-9a08-46b0-a615-72d044a774d9 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.661329 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e51a3a-9a08-46b0-a615-72d044a774d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.661809 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e51a3a-9a08-46b0-a615-72d044a774d9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.675992 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e51a3a-9a08-46b0-a615-72d044a774d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-18e51a3a-9a08-46b0-a615-72d044a774d9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:21.685346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:21.686348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:21.687137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:21.694941 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 151/301] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:21.697552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8beaa-392e-4e90-991c-027ac7dc95ef None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:21.882302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:21.943013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8beaa-392e-4e90-991c-027ac7dc95ef None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:21.985386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f0e7c-3298-4c4a-a093-8f1668dea78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:21.986445 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f0e7c-3298-4c4a-a093-8f1668dea78e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.986931 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f0e7c-3298-4c4a-a093-8f1668dea78e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.987488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f0e7c-3298-4c4a-a093-8f1668dea78e None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.988505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f0e7c-3298-4c4a-a093-8f1668dea78e None admin] RBAC: Adding query filter params (name=reader) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:21.989033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f0e7c-3298-4c4a-a093-8f1668dea78e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:21.989482 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0322ca-54f6-4f2f-b9b1-a2563cb5cde8 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.989918 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0322ca-54f6-4f2f-b9b1-a2563cb5cde8 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.990053 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0322ca-54f6-4f2f-b9b1-a2563cb5cde8 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:21.991420 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f0e7c-3298-4c4a-a093-8f1668dea78e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:21.991837 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 152/302] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:21.997540 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796343d4-4ff9-4cb3-a68c-0f141e7fb11b None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:21.997891 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796343d4-4ff9-4cb3-a68c-0f141e7fb11b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:21.998248 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796343d4-4ff9-4cb3-a68c-0f141e7fb11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.007622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 151/303] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:22.011279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f0e7c-3298-4c4a-a093-8f1668dea78e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.022787 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-796343d4-4ff9-4cb3-a68c-0f141e7fb11b None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:22.025914 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-796343d4-4ff9-4cb3-a68c-0f141e7fb11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:22.152680 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 153/304] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:22.187470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f0e7c-3298-4c4a-a093-8f1668dea78e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.197605 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796343d4-4ff9-4cb3-a68c-0f141e7fb11b None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.200854 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:22.262218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:22.275117 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7cc24-03e4-493f-a45a-c9a9eceafa2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.276165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7cc24-03e4-493f-a45a-c9a9eceafa2f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.276474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7cc24-03e4-493f-a45a-c9a9eceafa2f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.277163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7cc24-03e4-493f-a45a-c9a9eceafa2f None admin] PATH_INFO: `/v3/users/33c59214f5df472ba962116f7498d0d5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.302449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7cc24-03e4-493f-a45a-c9a9eceafa2f None admin] RBAC: Authorizing `identity:get_user(user_id=33c59214f5df472ba962116f7498d0d5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.304325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7cc24-03e4-493f-a45a-c9a9eceafa2f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:22.306995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 152/305] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:22 2022] GET /identity/v3/users/33c59214f5df472ba962116f7498d0d5 => generated 293 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:22.313652 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7cc24-03e4-493f-a45a-c9a9eceafa2f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.361451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796343d4-4ff9-4cb3-a68c-0f141e7fb11b None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.412662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeafba0-affe-4dc9-8ce0-c54c7311dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.413422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafba0-affe-4dc9-8ce0-c54c7311dd52 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.413707 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafba0-affe-4dc9-8ce0-c54c7311dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.413985 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeafba0-affe-4dc9-8ce0-c54c7311dd52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.428781 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeafba0-affe-4dc9-8ce0-c54c7311dd52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-6aeafba0-affe-4dc9-8ce0-c54c7311dd52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:22.438430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:22.448664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:22.449904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 154/306] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:22.453709 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeafba0-affe-4dc9-8ce0-c54c7311dd52 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.481833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7cc24-03e4-493f-a45a-c9a9eceafa2f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.529481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a7c0-604c-46f9-b75c-7c57ad733c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.531075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a7c0-604c-46f9-b75c-7c57ad733c3a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.531075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a7c0-604c-46f9-b75c-7c57ad733c3a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.531075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4a7c0-604c-46f9-b75c-7c57ad733c3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.531829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4a7c0-604c-46f9-b75c-7c57ad733c3a None admin] RBAC: Adding query filter params (role.id=475524a4f2b44b66a7c5935c0ded858e, user.id=33c59214f5df472ba962116f7498d0d5, scope.system=all) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:22.532157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4a7c0-604c-46f9-b75c-7c57ad733c3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.533785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4a7c0-604c-46f9-b75c-7c57ad733c3a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:22.549917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 153/307] 10.222.0.24 () {56 vars in 1308 bytes} [Sat Jun 4 20:35:22 2022] GET /identity/v3/role_assignments?user.id=33c59214f5df472ba962116f7498d0d5&scope.system=all&role.id=475524a4f2b44b66a7c5935c0ded858e => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:22.590926 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:22.673761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeafba0-affe-4dc9-8ce0-c54c7311dd52 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.744139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8358d5-59b5-4781-9e31-3544ccd15155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.745932 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8358d5-59b5-4781-9e31-3544ccd15155 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.746878 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8358d5-59b5-4781-9e31-3544ccd15155 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.747643 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8358d5-59b5-4781-9e31-3544ccd15155 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.749588 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8358d5-59b5-4781-9e31-3544ccd15155 None admin] RBAC: Adding query filter params (name=member) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:22.750363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8358d5-59b5-4781-9e31-3544ccd15155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.753423 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8358d5-59b5-4781-9e31-3544ccd15155 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:22.776615 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 155/308] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:22.781334 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a7c0-604c-46f9-b75c-7c57ad733c3a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:22.852235 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:22.910055 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dae17-fb58-400e-8c97-30249c78952b None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.910366 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dae17-fb58-400e-8c97-30249c78952b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.910709 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046dae17-fb58-400e-8c97-30249c78952b None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.912352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 156/309] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:22.915372 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4a7c0-604c-46f9-b75c-7c57ad733c3a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:22.918481 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392c6e-80bd-4a85-a867-a7c9c12e6314 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.918720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392c6e-80bd-4a85-a867-a7c9c12e6314 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.918859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44392c6e-80bd-4a85-a867-a7c9c12e6314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.939173 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-44392c6e-80bd-4a85-a867-a7c9c12e6314 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:22.941052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-44392c6e-80bd-4a85-a867-a7c9c12e6314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:22.958547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a889c-1aad-4a6b-8b4d-f167ee94c8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:22.959467 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a889c-1aad-4a6b-8b4d-f167ee94c8fb None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:22.959749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a889c-1aad-4a6b-8b4d-f167ee94c8fb None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:22.960027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a889c-1aad-4a6b-8b4d-f167ee94c8fb None admin] PATH_INFO: `/v3/users/2737a2899c124a7eb59e2b66840c7a81` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:22.961448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a889c-1aad-4a6b-8b4d-f167ee94c8fb None admin] RBAC: Authorizing `identity:get_user(user_id=2737a2899c124a7eb59e2b66840c7a81)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:22.963036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273a889c-1aad-4a6b-8b4d-f167ee94c8fb None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:22.964903 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 154/310] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:22 2022] GET /identity/v3/users/2737a2899c124a7eb59e2b66840c7a81 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:22.970785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a889c-1aad-4a6b-8b4d-f167ee94c8fb None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:23.066747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 157/311] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:23.092159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44392c6e-80bd-4a85-a867-a7c9c12e6314 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:23.113467 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273a889c-1aad-4a6b-8b4d-f167ee94c8fb None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:23.140209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:23.160557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8e034-4c03-4d5a-9717-509e40753efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:23.161939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8e034-4c03-4d5a-9717-509e40753efa None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:23.162376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8e034-4c03-4d5a-9717-509e40753efa None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:23.162773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8e034-4c03-4d5a-9717-509e40753efa None admin] PATH_INFO: `/v3/system/users/2737a2899c124a7eb59e2b66840c7a81/roles/52b41e61eb19402aa67a7defc45d7f5f` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:23.168480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8e034-4c03-4d5a-9717-509e40753efa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2737a2899c124a7eb59e2b66840c7a81, role_id=52b41e61eb19402aa67a7defc45d7f5f)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:23.168480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8e034-4c03-4d5a-9717-509e40753efa None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:23.184813 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 155/312] 10.222.0.24 () {58 vars in 1334 bytes} [Sat Jun 4 20:35:22 2022] PUT /identity/v3/system/users/2737a2899c124a7eb59e2b66840c7a81/roles/52b41e61eb19402aa67a7defc45d7f5f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:35:23.220671 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:23.315071 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44392c6e-80bd-4a85-a867-a7c9c12e6314 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:23.385302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd9460-9b02-4bf3-8c4c-a0b2c8ab110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:23.387062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd9460-9b02-4bf3-8c4c-a0b2c8ab110d None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:23.387578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd9460-9b02-4bf3-8c4c-a0b2c8ab110d None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:23.388063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbd9460-9b02-4bf3-8c4c-a0b2c8ab110d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:23.411671 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbd9460-9b02-4bf3-8c4c-a0b2c8ab110d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-5dbd9460-9b02-4bf3-8c4c-a0b2c8ab110d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:23.427846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:23.428841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:23.429600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:23.430744 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 158/313] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:23.437034 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8e034-4c03-4d5a-9717-509e40753efa None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:23.604486 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8e034-4c03-4d5a-9717-509e40753efa None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:23.643429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53876-c351-4c58-a21b-482ecbc12f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:23.644116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53876-c351-4c58-a21b-482ecbc12f6d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:23.644406 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53876-c351-4c58-a21b-482ecbc12f6d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:23.644743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c53876-c351-4c58-a21b-482ecbc12f6d None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:23.645532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c53876-c351-4c58-a21b-482ecbc12f6d None admin] RBAC: Adding query filter params (name=reader) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:23.645845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c53876-c351-4c58-a21b-482ecbc12f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:23.647298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c53876-c351-4c58-a21b-482ecbc12f6d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:23.657647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 156/314] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:23.662977 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd9460-9b02-4bf3-8c4c-a0b2c8ab110d None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:23.787090 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbd9460-9b02-4bf3-8c4c-a0b2c8ab110d None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:23.819054 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:23.847446 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77a635-01bb-4220-ac4d-247fbf905fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:23.848694 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77a635-01bb-4220-ac4d-247fbf905fec None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:23.849136 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77a635-01bb-4220-ac4d-247fbf905fec None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:23.849560 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77a635-01bb-4220-ac4d-247fbf905fec None admin] PATH_INFO: `/v3/users/84491f7691f1402a9fcfe2babb109eb0` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:23.851158 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77a635-01bb-4220-ac4d-247fbf905fec None admin] RBAC: Authorizing `identity:get_user(user_id=84491f7691f1402a9fcfe2babb109eb0)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:23.852864 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca77a635-01bb-4220-ac4d-247fbf905fec None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:23.855229 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 159/315] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:23 2022] GET /identity/v3/users/84491f7691f1402a9fcfe2babb109eb0 => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:23.861686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53876-c351-4c58-a21b-482ecbc12f6d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:23.916750 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:23.977166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c53876-c351-4c58-a21b-482ecbc12f6d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:24.018407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5019c05-9fc6-4eeb-b6b2-96d64a44859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:24.019389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019c05-9fc6-4eeb-b6b2-96d64a44859f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:24.019901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019c05-9fc6-4eeb-b6b2-96d64a44859f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:24.020321 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5019c05-9fc6-4eeb-b6b2-96d64a44859f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:24.109024 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5019c05-9fc6-4eeb-b6b2-96d64a44859f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:24.110825 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5019c05-9fc6-4eeb-b6b2-96d64a44859f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:24.157755 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd652a1-7137-49fa-a522-9fecbd2902c5 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:24.159276 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd652a1-7137-49fa-a522-9fecbd2902c5 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:24.159787 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd652a1-7137-49fa-a522-9fecbd2902c5 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:24.162340 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 160/316] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:24.169094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:24.169292 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d14a-138b-42ad-8de1-44e4af8fc6f8 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:24.169292 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d14a-138b-42ad-8de1-44e4af8fc6f8 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:24.170522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d14a-138b-42ad-8de1-44e4af8fc6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:24.197886 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-5ce6d14a-138b-42ad-8de1-44e4af8fc6f8 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:24.199159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-5ce6d14a-138b-42ad-8de1-44e4af8fc6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:24.253904 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 157/317] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:24.261587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5019c05-9fc6-4eeb-b6b2-96d64a44859f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:24.288579 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 161/318] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:24.315744 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6d14a-138b-42ad-8de1-44e4af8fc6f8 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:24.401379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5019c05-9fc6-4eeb-b6b2-96d64a44859f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:24.441924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6d14a-138b-42ad-8de1-44e4af8fc6f8 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:24.447829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bc3f2-0792-4ab8-ae39-3c94cbb90fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:24.449115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc3f2-0792-4ab8-ae39-3c94cbb90fb1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:24.449595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc3f2-0792-4ab8-ae39-3c94cbb90fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:24.450097 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bc3f2-0792-4ab8-ae39-3c94cbb90fb1 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:24.451702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bc3f2-0792-4ab8-ae39-3c94cbb90fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:24.453529 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bc3f2-0792-4ab8-ae39-3c94cbb90fb1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:24.459121 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:24.460932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 158/319] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:24 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:24.462165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bc3f2-0792-4ab8-ae39-3c94cbb90fb1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:24.481473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:24.496673 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e01bb2-ee68-44da-95cd-3586aae6be32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:24.498079 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01bb2-ee68-44da-95cd-3586aae6be32 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:24.498507 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01bb2-ee68-44da-95cd-3586aae6be32 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:24.498946 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e01bb2-ee68-44da-95cd-3586aae6be32 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:24.501337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e01bb2-ee68-44da-95cd-3586aae6be32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:24.503425 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e01bb2-ee68-44da-95cd-3586aae6be32 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:24.505520 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 162/320] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:24.512740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e01bb2-ee68-44da-95cd-3586aae6be32 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:24.607533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bc3f2-0792-4ab8-ae39-3c94cbb90fb1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:24.648090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d4193-e583-477e-be0c-adddc8ada7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:24.649159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d4193-e583-477e-be0c-adddc8ada7a9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:24.649614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d4193-e583-477e-be0c-adddc8ada7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:24.650103 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d4193-e583-477e-be0c-adddc8ada7a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:24.651158 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d4193-e583-477e-be0c-adddc8ada7a9 None admin] RBAC: Adding query filter params (role.id=475524a4f2b44b66a7c5935c0ded858e, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5, user.id=84491f7691f1402a9fcfe2babb109eb0) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:24.651711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d4193-e583-477e-be0c-adddc8ada7a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:24.653534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d4193-e583-477e-be0c-adddc8ada7a9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:24.660511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e01bb2-ee68-44da-95cd-3586aae6be32 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:24.661156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 159/321] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:24 2022] GET /identity/v3/role_assignments?user.id=84491f7691f1402a9fcfe2babb109eb0&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=475524a4f2b44b66a7c5935c0ded858e => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:24.715588 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d1562-918d-4cde-8011-29f457fbb176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:24.716350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d1562-918d-4cde-8011-29f457fbb176 None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:24.716699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d1562-918d-4cde-8011-29f457fbb176 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:24.716981 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d1562-918d-4cde-8011-29f457fbb176 None admin] PATH_INFO: `/v3/groups` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:24.717732 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d1562-918d-4cde-8011-29f457fbb176 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:24.719313 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d1562-918d-4cde-8011-29f457fbb176 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:24.744808 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 163/322] 10.222.0.24 () {60 vars in 1134 bytes} [Sat Jun 4 20:35:24 2022] POST /identity/v3/groups => generated 226 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:25.903677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8b310-37db-4fd5-bdb1-dee1414912bb None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:25.904549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8b310-37db-4fd5-bdb1-dee1414912bb None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:25.904831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8b310-37db-4fd5-bdb1-dee1414912bb None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:25.906456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 160/323] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:25.912608 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf763b-cab1-4efe-a7e7-6bd7ee75f6bf None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:25.913128 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf763b-cab1-4efe-a7e7-6bd7ee75f6bf None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:25.913204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf763b-cab1-4efe-a7e7-6bd7ee75f6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:25.937607 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-06bf763b-cab1-4efe-a7e7-6bd7ee75f6bf None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:25.938853 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-06bf763b-cab1-4efe-a7e7-6bd7ee75f6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:25.980635 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:26.029219 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 164/324] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:26.082091 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8b310-37db-4fd5-bdb1-dee1414912bb None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:26.190350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:26.217101 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac8b310-37db-4fd5-bdb1-dee1414912bb None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:26.276614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff0cb-0a30-45d5-928f-df1d56045774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:26.277456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff0cb-0a30-45d5-928f-df1d56045774 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:26.277783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff0cb-0a30-45d5-928f-df1d56045774 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:26.278061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61ff0cb-0a30-45d5-928f-df1d56045774 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:26.296727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61ff0cb-0a30-45d5-928f-df1d56045774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:26.302384 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c63a-84c3-4d79-9c9c-3d4cb78fbda2 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:26.302994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c63a-84c3-4d79-9c9c-3d4cb78fbda2 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:26.303488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520c63a-84c3-4d79-9c9c-3d4cb78fbda2 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-d61ff0cb-0a30-45d5-928f-df1d56045774 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:26.304959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:26.305831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:26.306695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:26.312580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 161/325] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:26.313561 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 165/326] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:26 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:26.316357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff0cb-0a30-45d5-928f-df1d56045774 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:26.321316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b0654-45e1-4c84-ae6e-fd4fd6b9da9e None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:26.321984 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b0654-45e1-4c84-ae6e-fd4fd6b9da9e None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:26.322466 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b0654-45e1-4c84-ae6e-fd4fd6b9da9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:26.348282 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-896b0654-45e1-4c84-ae6e-fd4fd6b9da9e None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:26.349972 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-896b0654-45e1-4c84-ae6e-fd4fd6b9da9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:26.488515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61ff0cb-0a30-45d5-928f-df1d56045774 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:26.501736 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 166/327] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:26.538761 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac8610-ebd5-45a8-ba7c-85dc0f791b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:26.539470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8610-ebd5-45a8-ba7c-85dc0f791b96 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:26.539761 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8610-ebd5-45a8-ba7c-85dc0f791b96 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:26.540041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac8610-ebd5-45a8-ba7c-85dc0f791b96 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:26.541289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac8610-ebd5-45a8-ba7c-85dc0f791b96 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:26.541655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac8610-ebd5-45a8-ba7c-85dc0f791b96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:26.543158 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac8610-ebd5-45a8-ba7c-85dc0f791b96 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:26.549563 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:26.558968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 162/328] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:26.561043 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b0654-45e1-4c84-ae6e-fd4fd6b9da9e None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:26.588694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac8610-ebd5-45a8-ba7c-85dc0f791b96 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:26.712253 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac8610-ebd5-45a8-ba7c-85dc0f791b96 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:26.733373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:26.740358 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b0654-45e1-4c84-ae6e-fd4fd6b9da9e None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:26.755072 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f41252-5ace-4705-a2ec-4807dd0cd089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:26.755900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f41252-5ace-4705-a2ec-4807dd0cd089 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:26.756188 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f41252-5ace-4705-a2ec-4807dd0cd089 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:26.756501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f41252-5ace-4705-a2ec-4807dd0cd089 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:26.771543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f41252-5ace-4705-a2ec-4807dd0cd089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-22f41252-5ace-4705-a2ec-4807dd0cd089 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:26.780269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:26.781250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:26.782007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 163/329] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:26.791585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f41252-5ace-4705-a2ec-4807dd0cd089 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:26.822567 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9439bb-6455-407d-af0a-ad4b8df6b9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:26.823504 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9439bb-6455-407d-af0a-ad4b8df6b9c5 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:26.823791 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9439bb-6455-407d-af0a-ad4b8df6b9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:26.824071 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9439bb-6455-407d-af0a-ad4b8df6b9c5 None admin] PATH_INFO: `/v3/users/2737a2899c124a7eb59e2b66840c7a81` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:26.826838 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9439bb-6455-407d-af0a-ad4b8df6b9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=2737a2899c124a7eb59e2b66840c7a81)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:26.828350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9439bb-6455-407d-af0a-ad4b8df6b9c5 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:26.830809 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 167/330] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:26 2022] GET /identity/v3/users/2737a2899c124a7eb59e2b66840c7a81 => generated 293 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:26.842152 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9439bb-6455-407d-af0a-ad4b8df6b9c5 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:26.911652 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:27.015443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f41252-5ace-4705-a2ec-4807dd0cd089 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:27.085903 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0cef3-16dc-4b93-ac81-9952fdba8fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:27.086932 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9439bb-6455-407d-af0a-ad4b8df6b9c5 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:27.087610 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0cef3-16dc-4b93-ac81-9952fdba8fb8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:27.088087 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0cef3-16dc-4b93-ac81-9952fdba8fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:27.088626 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0cef3-16dc-4b93-ac81-9952fdba8fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:27.089611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0cef3-16dc-4b93-ac81-9952fdba8fb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:27.090119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0cef3-16dc-4b93-ac81-9952fdba8fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:27.091749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0cef3-16dc-4b93-ac81-9952fdba8fb8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:27.108374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 164/331] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:27.120742 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0cef3-16dc-4b93-ac81-9952fdba8fb8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:27.151344 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba0e7b-1325-4c86-beb5-544cdac02c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:27.152035 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba0e7b-1325-4c86-beb5-544cdac02c2b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:27.152372 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba0e7b-1325-4c86-beb5-544cdac02c2b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:27.152679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bba0e7b-1325-4c86-beb5-544cdac02c2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:27.153590 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba0e7b-1325-4c86-beb5-544cdac02c2b None admin] RBAC: Adding query filter params (role.id=52b41e61eb19402aa67a7defc45d7f5f, user.id=2737a2899c124a7eb59e2b66840c7a81, scope.system=all) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:27.153975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba0e7b-1325-4c86-beb5-544cdac02c2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:27.155488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bba0e7b-1325-4c86-beb5-544cdac02c2b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:27.179348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 168/332] 10.222.0.24 () {56 vars in 1308 bytes} [Sat Jun 4 20:35:26 2022] GET /identity/v3/role_assignments?user.id=2737a2899c124a7eb59e2b66840c7a81&scope.system=all&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 510 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:27.300776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0cef3-16dc-4b93-ac81-9952fdba8fb8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:27.329065 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:27.344604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6d6d61-5368-46e7-b107-2f27526fc932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:27.346020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6d61-5368-46e7-b107-2f27526fc932 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:27.346526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6d61-5368-46e7-b107-2f27526fc932 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:27.346998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6d6d61-5368-46e7-b107-2f27526fc932 None admin] PATH_INFO: `/v3/users/33c59214f5df472ba962116f7498d0d5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:27.353648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d6d61-5368-46e7-b107-2f27526fc932 None admin] RBAC: Authorizing `identity:get_user(user_id=33c59214f5df472ba962116f7498d0d5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:27.355767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6d6d61-5368-46e7-b107-2f27526fc932 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:27.358496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 165/333] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:27 2022] GET /identity/v3/users/33c59214f5df472ba962116f7498d0d5 => generated 293 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:27.366892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba0e7b-1325-4c86-beb5-544cdac02c2b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:27.426166 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:27.541185 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bba0e7b-1325-4c86-beb5-544cdac02c2b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:27.598303 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41d0a7-2c69-4d23-b69e-c1d430bf03f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:27.599127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d0a7-2c69-4d23-b69e-c1d430bf03f2 None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:27.599415 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d0a7-2c69-4d23-b69e-c1d430bf03f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:27.599699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41d0a7-2c69-4d23-b69e-c1d430bf03f2 None admin] PATH_INFO: `/v3/system/users/33c59214f5df472ba962116f7498d0d5/roles/475524a4f2b44b66a7c5935c0ded858e` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:27.601462 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41d0a7-2c69-4d23-b69e-c1d430bf03f2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=33c59214f5df472ba962116f7498d0d5, role_id=475524a4f2b44b66a7c5935c0ded858e)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:27.602995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41d0a7-2c69-4d23-b69e-c1d430bf03f2 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:27.623883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 169/334] 10.222.0.24 () {58 vars in 1334 bytes} [Sat Jun 4 20:35:27 2022] PUT /identity/v3/system/users/33c59214f5df472ba962116f7498d0d5/roles/475524a4f2b44b66a7c5935c0ded858e => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:28.019135 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14c17-4e0b-49b4-ab54-f47827b05046 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.020293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14c17-4e0b-49b4-ab54-f47827b05046 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.020833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef14c17-4e0b-49b4-ab54-f47827b05046 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.023046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 166/335] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:28.029873 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f349987-d74b-428b-9ab3-a55b51800b61 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.030532 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f349987-d74b-428b-9ab3-a55b51800b61 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.031028 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f349987-d74b-428b-9ab3-a55b51800b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.057740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-5f349987-d74b-428b-9ab3-a55b51800b61 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:28.059338 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-5f349987-d74b-428b-9ab3-a55b51800b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:28.145634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 170/336] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:28.191730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef14c17-4e0b-49b4-ab54-f47827b05046 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:28.337793 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef14c17-4e0b-49b4-ab54-f47827b05046 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:28.395454 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d9fcf-e052-4f28-8669-301a5d02bced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:28.396299 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9fcf-e052-4f28-8669-301a5d02bced None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.396625 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9fcf-e052-4f28-8669-301a5d02bced None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.396907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d9fcf-e052-4f28-8669-301a5d02bced None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.413705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d9fcf-e052-4f28-8669-301a5d02bced None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-7d7d9fcf-e052-4f28-8669-301a5d02bced None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:28.423841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:28.424831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:28.425591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 167/337] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:28.433129 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f349987-d74b-428b-9ab3-a55b51800b61 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:28.469042 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:28.603360 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f349987-d74b-428b-9ab3-a55b51800b61 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:28.667927 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124052f4-fa39-42e1-a4a7-2e232e347976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:28.668929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124052f4-fa39-42e1-a4a7-2e232e347976 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.669217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124052f4-fa39-42e1-a4a7-2e232e347976 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.669493 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124052f4-fa39-42e1-a4a7-2e232e347976 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.670297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124052f4-fa39-42e1-a4a7-2e232e347976 None admin] RBAC: Adding query filter params (name=member) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:28.670607 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124052f4-fa39-42e1-a4a7-2e232e347976 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:28.672140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124052f4-fa39-42e1-a4a7-2e232e347976 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:28.690750 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 171/338] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:28.699680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d9fcf-e052-4f28-8669-301a5d02bced None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:28.720999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dff0b-a2d4-434b-a8dd-62dbda63c368 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.721554 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dff0b-a2d4-434b-a8dd-62dbda63c368 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.721959 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dff0b-a2d4-434b-a8dd-62dbda63c368 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.725266 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 172/339] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:28.731532 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903f1a1-d2f1-4889-8021-8ca65e1639a4 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:28.732085 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903f1a1-d2f1-4889-8021-8ca65e1639a4 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:28.732532 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903f1a1-d2f1-4889-8021-8ca65e1639a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:28.778276 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-1903f1a1-d2f1-4889-8021-8ca65e1639a4 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:28.783686 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-1903f1a1-d2f1-4889-8021-8ca65e1639a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:28.867004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:28.938941 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 173/340] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:29.032498 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903f1a1-d2f1-4889-8021-8ca65e1639a4 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:29.037351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d9fcf-e052-4f28-8669-301a5d02bced None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:29.070690 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:29.180348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385484b3-f8e0-4a47-90cc-00da89ba8ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:29.180348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385484b3-f8e0-4a47-90cc-00da89ba8ac2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:29.180348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385484b3-f8e0-4a47-90cc-00da89ba8ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:29.180348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385484b3-f8e0-4a47-90cc-00da89ba8ac2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:29.331985 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903f1a1-d2f1-4889-8021-8ca65e1639a4 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:29.424804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385484b3-f8e0-4a47-90cc-00da89ba8ac2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:29.427560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385484b3-f8e0-4a47-90cc-00da89ba8ac2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:29.444705 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425075a0-fc13-4076-96ac-bf1a82bad5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:29.445435 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425075a0-fc13-4076-96ac-bf1a82bad5a6 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:29.445756 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425075a0-fc13-4076-96ac-bf1a82bad5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:29.445995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425075a0-fc13-4076-96ac-bf1a82bad5a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:29.484030 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425075a0-fc13-4076-96ac-bf1a82bad5a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-425075a0-fc13-4076-96ac-bf1a82bad5a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:29.497773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:29.499475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:29.501667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 174/341] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 467 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:29.513604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425075a0-fc13-4076-96ac-bf1a82bad5a6 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:29.528791 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:29.690562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 168/342] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 992 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:29.703689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385484b3-f8e0-4a47-90cc-00da89ba8ac2 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:29.773039 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:29.869020 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425075a0-fc13-4076-96ac-bf1a82bad5a6 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:29.930312 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadc926-7081-411a-bc8f-24148eaaaa2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:29.931400 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadc926-7081-411a-bc8f-24148eaaaa2d None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:29.931791 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadc926-7081-411a-bc8f-24148eaaaa2d None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:29.932170 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadc926-7081-411a-bc8f-24148eaaaa2d None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:29.933210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadc926-7081-411a-bc8f-24148eaaaa2d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:29.933704 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadc926-7081-411a-bc8f-24148eaaaa2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:29.935279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadc926-7081-411a-bc8f-24148eaaaa2d None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:29.953972 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 175/343] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:29.961963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadc926-7081-411a-bc8f-24148eaaaa2d None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:29.998834 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385484b3-f8e0-4a47-90cc-00da89ba8ac2 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:30.114395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadc926-7081-411a-bc8f-24148eaaaa2d None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:30.121297 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6e207-7273-4437-9a17-e8a4d7a2ace6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:30.122369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6e207-7273-4437-9a17-e8a4d7a2ace6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.122755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6e207-7273-4437-9a17-e8a4d7a2ace6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.123133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6e207-7273-4437-9a17-e8a4d7a2ace6 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.124676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6e207-7273-4437-9a17-e8a4d7a2ace6 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:30.126518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6e207-7273-4437-9a17-e8a4d7a2ace6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:30.129045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 169/344] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:29 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 426 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:30.136706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6e207-7273-4437-9a17-e8a4d7a2ace6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:30.168008 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38743de8-b928-48c0-abbd-624cefd9344b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:30.168966 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743de8-b928-48c0-abbd-624cefd9344b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.169327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743de8-b928-48c0-abbd-624cefd9344b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.169739 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38743de8-b928-48c0-abbd-624cefd9344b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.177030 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:30.193848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:30.319549 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38743de8-b928-48c0-abbd-624cefd9344b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:30.322431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38743de8-b928-48c0-abbd-624cefd9344b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:30.373363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6e207-7273-4437-9a17-e8a4d7a2ace6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:30.487823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b71ba-3940-4bf4-9620-6c0e4271c933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:30.493839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b71ba-3940-4bf4-9620-6c0e4271c933 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.494457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b71ba-3940-4bf4-9620-6c0e4271c933 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.495125 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b71ba-3940-4bf4-9620-6c0e4271c933 None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.503466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b71ba-3940-4bf4-9620-6c0e4271c933 None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:30.509820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b71ba-3940-4bf4-9620-6c0e4271c933 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:30.515042 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 170/345] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:30 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:30.518069 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93859c35-69d9-4b4b-9c49-da2e26285bf8 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.518851 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93859c35-69d9-4b4b-9c49-da2e26285bf8 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.519552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93859c35-69d9-4b4b-9c49-da2e26285bf8 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.529858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 171/346] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:30 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:30.534463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93859c35-69d9-4b4b-9c49-da2e26285bf8 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:30.630977 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 176/347] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:30.632763 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec7cee-5825-4c29-8a54-ff9dd88be939 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.633432 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec7cee-5825-4c29-8a54-ff9dd88be939 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.633945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec7cee-5825-4c29-8a54-ff9dd88be939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.692404 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-25ec7cee-5825-4c29-8a54-ff9dd88be939 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:30.694942 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-25ec7cee-5825-4c29-8a54-ff9dd88be939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:30.774270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:30.776974 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:30.851045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93859c35-69d9-4b4b-9c49-da2e26285bf8 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:30.887778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 177/348] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:30.889212 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec7cee-5825-4c29-8a54-ff9dd88be939 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:30.923153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3513cc-9440-4553-b3c0-42218b21a721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:30.923897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3513cc-9440-4553-b3c0-42218b21a721 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:30.924190 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3513cc-9440-4553-b3c0-42218b21a721 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:30.924492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3513cc-9440-4553-b3c0-42218b21a721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:30.925390 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3513cc-9440-4553-b3c0-42218b21a721 None admin] RBAC: Adding query filter params (group.id=c94793685c0a40978fd3533d7ad62607, role.id=52b41e61eb19402aa67a7defc45d7f5f, scope.project.id=2614591ccb4e488ba922d8212cdc54ee) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:30.925907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3513cc-9440-4553-b3c0-42218b21a721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:30.927613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3513cc-9440-4553-b3c0-42218b21a721 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:30.941215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 172/349] 10.222.0.24 () {56 vars in 1376 bytes} [Sat Jun 4 20:35:30 2022] GET /identity/v3/role_assignments?group.id=c94793685c0a40978fd3533d7ad62607&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 260 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:30.976354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3513cc-9440-4553-b3c0-42218b21a721 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:31.133849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec7cee-5825-4c29-8a54-ff9dd88be939 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.145412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3513cc-9440-4553-b3c0-42218b21a721 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.201460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4693d-ef93-43a4-9a07-81849c7695e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.202727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4693d-ef93-43a4-9a07-81849c7695e1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.203223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4693d-ef93-43a4-9a07-81849c7695e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.203723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4693d-ef93-43a4-9a07-81849c7695e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.219837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef4693d-ef93-43a4-9a07-81849c7695e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-8ef4693d-ef93-43a4-9a07-81849c7695e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:31.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:31.230099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:31.230906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:31.234190 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 173/350] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:31.243057 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf383ec4-ff70-4740-9d82-9fbd851f856c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.244059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf383ec4-ff70-4740-9d82-9fbd851f856c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.244347 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf383ec4-ff70-4740-9d82-9fbd851f856c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.244658 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf383ec4-ff70-4740-9d82-9fbd851f856c None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.245037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4693d-ef93-43a4-9a07-81849c7695e1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:31.246607 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf383ec4-ff70-4740-9d82-9fbd851f856c None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:31.248530 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf383ec4-ff70-4740-9d82-9fbd851f856c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:31.250994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 178/351] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:30 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:31.259273 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf383ec4-ff70-4740-9d82-9fbd851f856c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:31.263596 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:31.351035 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:31.467817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4693d-ef93-43a4-9a07-81849c7695e1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.504662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf383ec4-ff70-4740-9d82-9fbd851f856c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.518317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15acb6d-2ae3-4c76-8f00-89a12b4f63dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.519286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acb6d-2ae3-4c76-8f00-89a12b4f63dd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.519736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acb6d-2ae3-4c76-8f00-89a12b4f63dd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.520148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15acb6d-2ae3-4c76-8f00-89a12b4f63dd None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.521111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15acb6d-2ae3-4c76-8f00-89a12b4f63dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:31.521582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15acb6d-2ae3-4c76-8f00-89a12b4f63dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:31.523326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15acb6d-2ae3-4c76-8f00-89a12b4f63dd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:31.546113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 174/352] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:31.547268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afc87b-abb6-4327-9a6c-eec6394c53be None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.547547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afc87b-abb6-4327-9a6c-eec6394c53be None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.547837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44afc87b-abb6-4327-9a6c-eec6394c53be None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.549457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 175/353] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:31.554982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afc87b-abb6-4327-9a6c-eec6394c53be None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:31.585415 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764e52dd-6ed5-4b78-8ffc-f47867728ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.587033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e52dd-6ed5-4b78-8ffc-f47867728ad9 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.587596 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e52dd-6ed5-4b78-8ffc-f47867728ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.588105 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764e52dd-6ed5-4b78-8ffc-f47867728ad9 None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.590578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e52dd-6ed5-4b78-8ffc-f47867728ad9 None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:31.593478 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764e52dd-6ed5-4b78-8ffc-f47867728ad9 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:31.597174 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 179/354] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:31 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:31.599826 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0180-90c2-4ab6-bbd1-d10481aeb42c None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.600655 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0180-90c2-4ab6-bbd1-d10481aeb42c None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.601582 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0180-90c2-4ab6-bbd1-d10481aeb42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.636413 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-0b9c0180-90c2-4ab6-bbd1-d10481aeb42c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:31.639840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-0b9c0180-90c2-4ab6-bbd1-d10481aeb42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:31.645010 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:31.690823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44afc87b-abb6-4327-9a6c-eec6394c53be None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.732551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e52972-6967-49d5-817f-55c695f2ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.733221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e52972-6967-49d5-817f-55c695f2ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.733699 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e52972-6967-49d5-817f-55c695f2ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.734149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e52972-6967-49d5-817f-55c695f2ecc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.787116 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 180/355] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:31.789241 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c0180-90c2-4ab6-bbd1-d10481aeb42c None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:31.860841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:31.869818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e52972-6967-49d5-817f-55c695f2ecc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:31.871724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e52972-6967-49d5-817f-55c695f2ecc3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:31.945941 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c0180-90c2-4ab6-bbd1-d10481aeb42c None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:31.989538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8259c2-e734-448e-9acc-aa76cceab00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:31.990457 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8259c2-e734-448e-9acc-aa76cceab00b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:31.990895 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8259c2-e734-448e-9acc-aa76cceab00b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:31.991310 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8259c2-e734-448e-9acc-aa76cceab00b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:31.992321 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8259c2-e734-448e-9acc-aa76cceab00b None admin] RBAC: Adding query filter params (group.id=c94793685c0a40978fd3533d7ad62607, role.id=293f9e8d2aba452aadef740529c3d498, scope.project.id=2614591ccb4e488ba922d8212cdc54ee) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:31.992822 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8259c2-e734-448e-9acc-aa76cceab00b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:31.995479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8259c2-e734-448e-9acc-aa76cceab00b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:32.002638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 181/356] 10.222.0.24 () {56 vars in 1376 bytes} [Sat Jun 4 20:35:31 2022] GET /identity/v3/role_assignments?group.id=c94793685c0a40978fd3533d7ad62607&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=293f9e8d2aba452aadef740529c3d498 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:32.004098 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8259c2-e734-448e-9acc-aa76cceab00b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:32.064864 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:32.123724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:32.131673 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8259c2-e734-448e-9acc-aa76cceab00b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:32.177435 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a1263-49c7-44ee-a927-f013bde9709a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:32.178955 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a1263-49c7-44ee-a927-f013bde9709a None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:32.179515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a1263-49c7-44ee-a927-f013bde9709a None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:32.179933 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a1263-49c7-44ee-a927-f013bde9709a None admin] PATH_INFO: `/v3/roles/member` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:32.193240 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 176/357] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:32.194413 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a1263-49c7-44ee-a927-f013bde9709a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:32.199725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e52972-6967-49d5-817f-55c695f2ecc3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-264a1263-49c7-44ee-a927-f013bde9709a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:32.204114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:32.205264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:32.206236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:32.213261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 182/358] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:32.215082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcbf5e-f05a-4bea-ae17-25cdc69a072d None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:32.215521 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcbf5e-f05a-4bea-ae17-25cdc69a072d None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:32.215942 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcbf5e-f05a-4bea-ae17-25cdc69a072d None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:32.220227 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 183/359] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:32.221336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcbf5e-f05a-4bea-ae17-25cdc69a072d None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:32.372585 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcbf5e-f05a-4bea-ae17-25cdc69a072d None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:32.423503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e9d9d-3c9b-472e-b530-546566b73a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:32.424566 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e9d9d-3c9b-472e-b530-546566b73a62 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:32.425005 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e9d9d-3c9b-472e-b530-546566b73a62 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:32.425441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e9d9d-3c9b-472e-b530-546566b73a62 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:32.426372 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e9d9d-3c9b-472e-b530-546566b73a62 None admin] RBAC: Adding query filter params (name=member) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:32.426829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e9d9d-3c9b-472e-b530-546566b73a62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:32.428859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e9d9d-3c9b-472e-b530-546566b73a62 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:32.448012 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 184/360] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:32.454767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9008785-dcb5-4366-90db-9c46683f78b2 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:32.455306 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9008785-dcb5-4366-90db-9c46683f78b2 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:32.455725 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9008785-dcb5-4366-90db-9c46683f78b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:32.480032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-a9008785-dcb5-4366-90db-9c46683f78b2 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:32.481785 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-a9008785-dcb5-4366-90db-9c46683f78b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:32.512884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:32.542895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e52972-6967-49d5-817f-55c695f2ecc3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:32.578747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 185/361] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:32.580555 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9008785-dcb5-4366-90db-9c46683f78b2 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:32.654628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc2e9-f6a6-4168-a94f-5cd1c4ac7fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:32.655784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc2e9-f6a6-4168-a94f-5cd1c4ac7fb3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:32.656217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc2e9-f6a6-4168-a94f-5cd1c4ac7fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:32.656678 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fc2e9-f6a6-4168-a94f-5cd1c4ac7fb3 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:32.658151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fc2e9-f6a6-4168-a94f-5cd1c4ac7fb3 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:32.659833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670fc2e9-f6a6-4168-a94f-5cd1c4ac7fb3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:32.662294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 177/362] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:32 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:32.663403 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc2e9-f6a6-4168-a94f-5cd1c4ac7fb3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:32.709228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:32.729357 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9008785-dcb5-4366-90db-9c46683f78b2 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:32.784945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8f94-5165-4ba6-a718-9779e55646a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:32.787203 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8f94-5165-4ba6-a718-9779e55646a3 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:32.787777 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8f94-5165-4ba6-a718-9779e55646a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:32.788259 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff8f94-5165-4ba6-a718-9779e55646a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:32.808465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fc2e9-f6a6-4168-a94f-5cd1c4ac7fb3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:32.812486 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:32.863426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca5eab-4e36-44e6-90a3-489942590d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:32.864580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca5eab-4e36-44e6-90a3-489942590d65 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:32.865006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca5eab-4e36-44e6-90a3-489942590d65 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:32.865994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca5eab-4e36-44e6-90a3-489942590d65 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:32.888045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efca5eab-4e36-44e6-90a3-489942590d65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:32.889039 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff8f94-5165-4ba6-a718-9779e55646a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:32.891884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff8f94-5165-4ba6-a718-9779e55646a3 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-efca5eab-4e36-44e6-90a3-489942590d65 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:32.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:32.898308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:32.899081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:32.902149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 178/363] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:32.903392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca5eab-4e36-44e6-90a3-489942590d65 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:33.032328 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 186/364] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:33.033613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8f94-5165-4ba6-a718-9779e55646a3 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:33.041530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:33.049786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efca5eab-4e36-44e6-90a3-489942590d65 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:33.092203 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:33.097677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cd4b4-f1fe-4c06-b330-ba4e36fc66d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:33.098936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cd4b4-f1fe-4c06-b330-ba4e36fc66d8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:33.099384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cd4b4-f1fe-4c06-b330-ba4e36fc66d8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:33.099833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cd4b4-f1fe-4c06-b330-ba4e36fc66d8 None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:33.103417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366cd4b4-f1fe-4c06-b330-ba4e36fc66d8 None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:33.105447 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366cd4b4-f1fe-4c06-b330-ba4e36fc66d8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:33.107894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 179/365] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:32 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:33.109159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cd4b4-f1fe-4c06-b330-ba4e36fc66d8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:33.162676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff8f94-5165-4ba6-a718-9779e55646a3 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:33.204591 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68468b-6808-4fd0-8921-ceea265b4baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:33.205575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68468b-6808-4fd0-8921-ceea265b4baf None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:33.205951 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68468b-6808-4fd0-8921-ceea265b4baf None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:33.206447 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c68468b-6808-4fd0-8921-ceea265b4baf None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:33.207543 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68468b-6808-4fd0-8921-ceea265b4baf None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:33.208087 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68468b-6808-4fd0-8921-ceea265b4baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:33.209795 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c68468b-6808-4fd0-8921-ceea265b4baf None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:33.223743 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 187/366] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:33.225153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68468b-6808-4fd0-8921-ceea265b4baf None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:33.247616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cd4b4-f1fe-4c06-b330-ba4e36fc66d8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:33.304417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3998d06-a919-4117-9834-b99b964ef287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:33.305287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3998d06-a919-4117-9834-b99b964ef287 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:33.306153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3998d06-a919-4117-9834-b99b964ef287 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:33.306588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3998d06-a919-4117-9834-b99b964ef287 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:33.309013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3998d06-a919-4117-9834-b99b964ef287 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:33.311029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3998d06-a919-4117-9834-b99b964ef287 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:33.314311 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 180/367] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:33 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:33.315285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3998d06-a919-4117-9834-b99b964ef287 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:33.362192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c68468b-6808-4fd0-8921-ceea265b4baf None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:33.364764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:33.375442 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:33.415944 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95e9bf-e957-41da-b2e4-6d4aa1d9160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:33.416865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95e9bf-e957-41da-b2e4-6d4aa1d9160e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:33.417255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95e9bf-e957-41da-b2e4-6d4aa1d9160e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:33.417826 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95e9bf-e957-41da-b2e4-6d4aa1d9160e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:33.419438 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95e9bf-e957-41da-b2e4-6d4aa1d9160e None admin] RBAC: Adding query filter params (group.id=c94793685c0a40978fd3533d7ad62607, role.id=293f9e8d2aba452aadef740529c3d498, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:33.419877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95e9bf-e957-41da-b2e4-6d4aa1d9160e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:33.421850 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95e9bf-e957-41da-b2e4-6d4aa1d9160e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:33.435311 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 188/368] 10.222.0.24 () {56 vars in 1376 bytes} [Sat Jun 4 20:35:33 2022] GET /identity/v3/role_assignments?group.id=c94793685c0a40978fd3533d7ad62607&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=293f9e8d2aba452aadef740529c3d498 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:33.435311 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6154-e77f-4072-b4b7-5d09b3f99d53 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:33.435311 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6154-e77f-4072-b4b7-5d09b3f99d53 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:33.435311 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6154-e77f-4072-b4b7-5d09b3f99d53 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:33.435733 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 189/369] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:33.436688 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6154-e77f-4072-b4b7-5d09b3f99d53 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:33.503818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3998d06-a919-4117-9834-b99b964ef287 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:33.611159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be62db7-a03a-40a3-9cc4-3f70deafed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:33.613065 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be62db7-a03a-40a3-9cc4-3f70deafed79 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:33.613863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be62db7-a03a-40a3-9cc4-3f70deafed79 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:33.614628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be62db7-a03a-40a3-9cc4-3f70deafed79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:33.638428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6154-e77f-4072-b4b7-5d09b3f99d53 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:33.738816 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bfe13-af07-4f39-a26c-95700ff89d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:33.740464 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfe13-af07-4f39-a26c-95700ff89d82 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:33.740896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfe13-af07-4f39-a26c-95700ff89d82 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:33.741347 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bfe13-af07-4f39-a26c-95700ff89d82 None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:33.742813 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bfe13-af07-4f39-a26c-95700ff89d82 None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:33.749122 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bfe13-af07-4f39-a26c-95700ff89d82 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:33.756550 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 190/370] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:33 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:33.758610 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd3678-c9a8-49c2-93f3-c6ee6c260104 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:33.759159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd3678-c9a8-49c2-93f3-c6ee6c260104 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:33.759635 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd3678-c9a8-49c2-93f3-c6ee6c260104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:33.805780 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-37bd3678-c9a8-49c2-93f3-c6ee6c260104 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:33.808218 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-37bd3678-c9a8-49c2-93f3-c6ee6c260104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:33.813634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be62db7-a03a-40a3-9cc4-3f70deafed79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:33.815567 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be62db7-a03a-40a3-9cc4-3f70deafed79 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:33.851412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:33.895008 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:33.945304 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 181/371] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:33.947944 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be62db7-a03a-40a3-9cc4-3f70deafed79 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:33.986235 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 191/372] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:33.987483 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd3678-c9a8-49c2-93f3-c6ee6c260104 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:34.146289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be62db7-a03a-40a3-9cc4-3f70deafed79 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:34.152857 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd3678-c9a8-49c2-93f3-c6ee6c260104 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:34.190372 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:34.200805 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c37f30-bfb5-4283-aa07-2af293b58612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:34.201901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37f30-bfb5-4283-aa07-2af293b58612 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.202392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37f30-bfb5-4283-aa07-2af293b58612 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.202912 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c37f30-bfb5-4283-aa07-2af293b58612 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.203974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c37f30-bfb5-4283-aa07-2af293b58612 None admin] RBAC: Adding query filter params (group.id=c94793685c0a40978fd3533d7ad62607, role.id=52b41e61eb19402aa67a7defc45d7f5f, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:34.204520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c37f30-bfb5-4283-aa07-2af293b58612 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:34.206352 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c37f30-bfb5-4283-aa07-2af293b58612 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:34.220731 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 182/373] 10.222.0.24 () {56 vars in 1376 bytes} [Sat Jun 4 20:35:33 2022] GET /identity/v3/role_assignments?group.id=c94793685c0a40978fd3533d7ad62607&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 260 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:34.222127 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c37f30-bfb5-4283-aa07-2af293b58612 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:34.227119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05c641-60f1-47b8-9487-a5efe2ddb9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:34.228893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05c641-60f1-47b8-9487-a5efe2ddb9dc None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.229446 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05c641-60f1-47b8-9487-a5efe2ddb9dc None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.229924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a05c641-60f1-47b8-9487-a5efe2ddb9dc None admin] PATH_INFO: `/v3/projects/a16b8488457e4e38a2b3d336cfdffb59` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.233263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05c641-60f1-47b8-9487-a5efe2ddb9dc None admin] RBAC: Authorizing `identity:get_project(project_id=a16b8488457e4e38a2b3d336cfdffb59)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:34.235064 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a05c641-60f1-47b8-9487-a5efe2ddb9dc None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:34.237546 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 192/374] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:33 2022] GET /identity/v3/projects/a16b8488457e4e38a2b3d336cfdffb59 => generated 344 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:34.247141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05c641-60f1-47b8-9487-a5efe2ddb9dc None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:34.332054 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:34.402869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c37f30-bfb5-4283-aa07-2af293b58612 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:34.433040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a05c641-60f1-47b8-9487-a5efe2ddb9dc None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:34.467639 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c56e5d-7c6c-44f1-b6b3-29860efa27ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:34.476554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c56e5d-7c6c-44f1-b6b3-29860efa27ee None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.477055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c56e5d-7c6c-44f1-b6b3-29860efa27ee None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.477329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c56e5d-7c6c-44f1-b6b3-29860efa27ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.490254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c56e5d-7c6c-44f1-b6b3-29860efa27ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-49c56e5d-7c6c-44f1-b6b3-29860efa27ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:34.502656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:34.504407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:34.505992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 183/375] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:34.510488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c56e5d-7c6c-44f1-b6b3-29860efa27ee None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:34.568021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10974e-eb23-4458-92d8-0f89d061ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:34.570327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10974e-eb23-4458-92d8-0f89d061ee54 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.576784 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10974e-eb23-4458-92d8-0f89d061ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.578070 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10974e-eb23-4458-92d8-0f89d061ee54 None admin] PATH_INFO: `/v3/groups/cf1d0c2392bf42a9b4d81efa80543e62` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.596788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10974e-eb23-4458-92d8-0f89d061ee54 None admin] RBAC: Authorizing `identity:get_group(group_id=cf1d0c2392bf42a9b4d81efa80543e62)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:34.600354 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10974e-eb23-4458-92d8-0f89d061ee54 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:34.604912 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 193/376] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:34 2022] GET /identity/v3/groups/cf1d0c2392bf42a9b4d81efa80543e62 => generated 229 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:34.613080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:34.616986 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10974e-eb23-4458-92d8-0f89d061ee54 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:34.681322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c56e5d-7c6c-44f1-b6b3-29860efa27ee None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:34.734281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90822a2f-4054-4d2d-b5a8-43095a3d09a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:34.735267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90822a2f-4054-4d2d-b5a8-43095a3d09a9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.735558 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90822a2f-4054-4d2d-b5a8-43095a3d09a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.735886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90822a2f-4054-4d2d-b5a8-43095a3d09a9 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.736809 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90822a2f-4054-4d2d-b5a8-43095a3d09a9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:34.739162 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90822a2f-4054-4d2d-b5a8-43095a3d09a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:34.742111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90822a2f-4054-4d2d-b5a8-43095a3d09a9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:34.756068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 184/377] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:34.762195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90822a2f-4054-4d2d-b5a8-43095a3d09a9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:34.847856 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10974e-eb23-4458-92d8-0f89d061ee54 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:34.852378 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:34.885572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90822a2f-4054-4d2d-b5a8-43095a3d09a9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:34.909000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:34.928548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7551c-7892-4985-ad36-0d0b9897f8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:34.928548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7551c-7892-4985-ad36-0d0b9897f8ef None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.929014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7551c-7892-4985-ad36-0d0b9897f8ef None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.929014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7551c-7892-4985-ad36-0d0b9897f8ef None admin] PATH_INFO: `/v3/users/33c59214f5df472ba962116f7498d0d5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.930388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7551c-7892-4985-ad36-0d0b9897f8ef None admin] RBAC: Authorizing `identity:get_user(user_id=33c59214f5df472ba962116f7498d0d5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:34.932113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b7551c-7892-4985-ad36-0d0b9897f8ef None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:34.939442 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 185/378] 10.222.0.24 () {56 vars in 1177 bytes} [Sat Jun 4 20:35:34 2022] GET /identity/v3/users/33c59214f5df472ba962116f7498d0d5 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:34.941845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7551c-7892-4985-ad36-0d0b9897f8ef None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:34.975469 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ecb139-633d-4416-9bbf-e21ab0ef6ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:34.976638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecb139-633d-4416-9bbf-e21ab0ef6ff8 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:34.977155 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecb139-633d-4416-9bbf-e21ab0ef6ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:34.977704 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ecb139-633d-4416-9bbf-e21ab0ef6ff8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:34.980291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecb139-633d-4416-9bbf-e21ab0ef6ff8 None admin] RBAC: Adding query filter params (group.id=cf1d0c2392bf42a9b4d81efa80543e62, role.id=f315b062be7e445fa9461a116f9c46ee, scope.project.id=a16b8488457e4e38a2b3d336cfdffb59) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:34.980892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecb139-633d-4416-9bbf-e21ab0ef6ff8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:34.983704 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ecb139-633d-4416-9bbf-e21ab0ef6ff8 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:35.012087 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 194/379] 10.222.0.24 () {56 vars in 1376 bytes} [Sat Jun 4 20:35:34 2022] GET /identity/v3/role_assignments?group.id=cf1d0c2392bf42a9b4d81efa80543e62&scope.project.id=a16b8488457e4e38a2b3d336cfdffb59&role.id=f315b062be7e445fa9461a116f9c46ee => generated 260 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:35.071688 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b7551c-7892-4985-ad36-0d0b9897f8ef None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:35.120732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3b8ba-88c6-408b-9bf1-3b519eabda62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:35.121497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b8ba-88c6-408b-9bf1-3b519eabda62 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:35.121798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b8ba-88c6-408b-9bf1-3b519eabda62 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:35.122079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3b8ba-88c6-408b-9bf1-3b519eabda62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:35.122971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3b8ba-88c6-408b-9bf1-3b519eabda62 None admin] RBAC: Adding query filter params (role.id=475524a4f2b44b66a7c5935c0ded858e, user.id=33c59214f5df472ba962116f7498d0d5, scope.system=all) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:35.123290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3b8ba-88c6-408b-9bf1-3b519eabda62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:35.124864 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3b8ba-88c6-408b-9bf1-3b519eabda62 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:35.145837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 186/380] 10.222.0.24 () {56 vars in 1308 bytes} [Sat Jun 4 20:35:34 2022] GET /identity/v3/role_assignments?user.id=33c59214f5df472ba962116f7498d0d5&scope.system=all&role.id=475524a4f2b44b66a7c5935c0ded858e => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:35.517960 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5c3f-436b-483a-b4f0-7d6dd6b698bc None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:35.518270 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5c3f-436b-483a-b4f0-7d6dd6b698bc None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:35.518677 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2c5c3f-436b-483a-b4f0-7d6dd6b698bc None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:35.520424 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 195/381] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:35.530770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc1f6-b28a-4e1a-a9ee-009cd6da4d7c None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:35.531586 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc1f6-b28a-4e1a-a9ee-009cd6da4d7c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:35.531586 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611dc1f6-b28a-4e1a-a9ee-009cd6da4d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:35.551611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-611dc1f6-b28a-4e1a-a9ee-009cd6da4d7c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:35.555644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-611dc1f6-b28a-4e1a-a9ee-009cd6da4d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:35.625011 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:35.670881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 187/382] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:35.759919 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c5c3f-436b-483a-b4f0-7d6dd6b698bc None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:36.005387 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2c5c3f-436b-483a-b4f0-7d6dd6b698bc None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:36.051583 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f0533-bb8b-4e15-9cd9-f77ebd26bcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:36.052823 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0533-bb8b-4e15-9cd9-f77ebd26bcb7 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:36.053316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0533-bb8b-4e15-9cd9-f77ebd26bcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:36.053821 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2f0533-bb8b-4e15-9cd9-f77ebd26bcb7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:36.067278 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2f0533-bb8b-4e15-9cd9-f77ebd26bcb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-bf2f0533-bb8b-4e15-9cd9-f77ebd26bcb7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:36.075829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:36.076825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:36.077592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:36.080548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 196/383] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:36.087911 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc1f6-b28a-4e1a-a9ee-009cd6da4d7c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:36.339607 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611dc1f6-b28a-4e1a-a9ee-009cd6da4d7c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:36.389111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fe8d8-a01f-4a58-be9c-9db06ac1d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:36.390228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fe8d8-a01f-4a58-be9c-9db06ac1d446 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:36.391065 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fe8d8-a01f-4a58-be9c-9db06ac1d446 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:36.391561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fe8d8-a01f-4a58-be9c-9db06ac1d446 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:36.392590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fe8d8-a01f-4a58-be9c-9db06ac1d446 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:36.393110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fe8d8-a01f-4a58-be9c-9db06ac1d446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:36.394818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6fe8d8-a01f-4a58-be9c-9db06ac1d446 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:36.407922 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 188/384] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:36.414274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f0533-bb8b-4e15-9cd9-f77ebd26bcb7 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:36.453701 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:36.556840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2f0533-bb8b-4e15-9cd9-f77ebd26bcb7 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:36.598920 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e7d31-f66d-465e-9a65-eecf4c84a590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:36.599834 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7d31-f66d-465e-9a65-eecf4c84a590 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:36.600168 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7d31-f66d-465e-9a65-eecf4c84a590 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:36.600466 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e7d31-f66d-465e-9a65-eecf4c84a590 None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:36.601834 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e7d31-f66d-465e-9a65-eecf4c84a590 None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:36.603876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e7d31-f66d-465e-9a65-eecf4c84a590 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:36.606175 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 197/385] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:36 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:36.612031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fe8d8-a01f-4a58-be9c-9db06ac1d446 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:36.665987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:36.758465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fe8d8-a01f-4a58-be9c-9db06ac1d446 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:36.809787 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a81550d-f068-47bd-87c7-ac31870f8bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:36.810715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81550d-f068-47bd-87c7-ac31870f8bee None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:36.811006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81550d-f068-47bd-87c7-ac31870f8bee None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:36.811287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a81550d-f068-47bd-87c7-ac31870f8bee None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:36.813208 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81550d-f068-47bd-87c7-ac31870f8bee None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:36.814791 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a81550d-f068-47bd-87c7-ac31870f8bee None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:36.817210 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 189/386] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:36 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:36.823518 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e7d31-f66d-465e-9a65-eecf4c84a590 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:36.969017 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:36.974919 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e7d31-f66d-465e-9a65-eecf4c84a590 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:37.017008 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa554d3b-1f06-4b13-876f-92279ff7f2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:37.017955 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554d3b-1f06-4b13-876f-92279ff7f2e5 None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.018339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554d3b-1f06-4b13-876f-92279ff7f2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.018492 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa554d3b-1f06-4b13-876f-92279ff7f2e5 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee/groups/c94793685c0a40978fd3533d7ad62607/roles/52b41e61eb19402aa67a7defc45d7f5f` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.020914 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554d3b-1f06-4b13-876f-92279ff7f2e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2614591ccb4e488ba922d8212cdc54ee, group_id=c94793685c0a40978fd3533d7ad62607, role_id=52b41e61eb19402aa67a7defc45d7f5f)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:37.022451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa554d3b-1f06-4b13-876f-92279ff7f2e5 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:37.053146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 198/387] 10.222.0.24 () {58 vars in 1442 bytes} [Sat Jun 4 20:35:36 2022] PUT /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee/groups/c94793685c0a40978fd3533d7ad62607/roles/52b41e61eb19402aa67a7defc45d7f5f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:37.880790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f902-6c30-43b1-bf42-29f06036021a None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.881467 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f902-6c30-43b1-bf42-29f06036021a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.881467 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f902-6c30-43b1-bf42-29f06036021a None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.883166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 190/388] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:37.888750 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813cd7-78b1-446f-b78c-7c6fc41b1130 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.889151 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813cd7-78b1-446f-b78c-7c6fc41b1130 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.889392 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813cd7-78b1-446f-b78c-7c6fc41b1130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.913612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-bd813cd7-78b1-446f-b78c-7c6fc41b1130 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:37.914992 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-bd813cd7-78b1-446f-b78c-7c6fc41b1130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:37.968479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7a948-65cf-4a3f-832d-200799c0e8a4 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.968890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7a948-65cf-4a3f-832d-200799c0e8a4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.969035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc7a948-65cf-4a3f-832d-200799c0e8a4 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:37.970774 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 191/389] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:37.993669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab3217-50e0-475c-9eb7-43810ef15328 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:37.994132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab3217-50e0-475c-9eb7-43810ef15328 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:37.994567 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aab3217-50e0-475c-9eb7-43810ef15328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:38.054761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 199/390] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:38.055555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-1aab3217-50e0-475c-9eb7-43810ef15328 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:38.057841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-1aab3217-50e0-475c-9eb7-43810ef15328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:38.163237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd813cd7-78b1-446f-b78c-7c6fc41b1130 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:38.217968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 192/391] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:38.323375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab3217-50e0-475c-9eb7-43810ef15328 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:38.447134 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:38.461300 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:38.484872 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd813cd7-78b1-446f-b78c-7c6fc41b1130 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:38.570833 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f59d95-1a80-4a3a-8492-3b26f63d904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:38.573588 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f59d95-1a80-4a3a-8492-3b26f63d904b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:38.576470 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f59d95-1a80-4a3a-8492-3b26f63d904b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:38.577559 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f59d95-1a80-4a3a-8492-3b26f63d904b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:38.617175 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f59d95-1a80-4a3a-8492-3b26f63d904b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-16f59d95-1a80-4a3a-8492-3b26f63d904b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:38.656651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:38.658456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:38.660044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:38.668495 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 200/392] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 505 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:38.677490 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f59d95-1a80-4a3a-8492-3b26f63d904b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:38.764693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aab3217-50e0-475c-9eb7-43810ef15328 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:38.856515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00179b2a-5bca-4114-bd0c-8e38ad387c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:38.857835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00179b2a-5bca-4114-bd0c-8e38ad387c27 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:38.858289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00179b2a-5bca-4114-bd0c-8e38ad387c27 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:38.858735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00179b2a-5bca-4114-bd0c-8e38ad387c27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:38.898929 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00179b2a-5bca-4114-bd0c-8e38ad387c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-00179b2a-5bca-4114-bd0c-8e38ad387c27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:38.928382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:38.930133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:38.931836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 193/393] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 609 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:38.940955 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00179b2a-5bca-4114-bd0c-8e38ad387c27 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.023260 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f59d95-1a80-4a3a-8492-3b26f63d904b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.090190 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0f207-a6b9-483f-b27a-c8a7e7a50c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.092373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0f207-a6b9-483f-b27a-c8a7e7a50c09 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.093073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0f207-a6b9-483f-b27a-c8a7e7a50c09 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.093729 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0f207-a6b9-483f-b27a-c8a7e7a50c09 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.095197 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0f207-a6b9-483f-b27a-c8a7e7a50c09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:39.095973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0f207-a6b9-483f-b27a-c8a7e7a50c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:39.098724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0f207-a6b9-483f-b27a-c8a7e7a50c09 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:39.114946 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 201/394] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:39.117693 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce8a0-696e-43f8-8d12-17a85083056d None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.118504 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce8a0-696e-43f8-8d12-17a85083056d None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.119238 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfce8a0-696e-43f8-8d12-17a85083056d None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.122598 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 202/395] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:39.132489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdf545-ce70-4cba-9971-8cde2d6471e8 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.132489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdf545-ce70-4cba-9971-8cde2d6471e8 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.132841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdf545-ce70-4cba-9971-8cde2d6471e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.138037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:39.152804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00179b2a-5bca-4114-bd0c-8e38ad387c27 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.165712 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:39.170965 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-8abdf545-ce70-4cba-9971-8cde2d6471e8 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:39.178057 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-8abdf545-ce70-4cba-9971-8cde2d6471e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:39.258019 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ac875-b117-48be-be51-e744b421b535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.261627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ac875-b117-48be-be51-e744b421b535 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.262429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ac875-b117-48be-be51-e744b421b535 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.263202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ac875-b117-48be-be51-e744b421b535 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.265375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ac875-b117-48be-be51-e744b421b535 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:39.267272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ac875-b117-48be-be51-e744b421b535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:39.270885 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ac875-b117-48be-be51-e744b421b535 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:39.291273 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 194/396] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:39.293492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ac875-b117-48be-be51-e744b421b535 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.348501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 203/397] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:39.348501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdf545-ce70-4cba-9971-8cde2d6471e8 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.480754 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ac875-b117-48be-be51-e744b421b535 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.534914 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4cf6ad-cdbb-4289-b86f-b0c4a4e4cd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.536891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf6ad-cdbb-4289-b86f-b0c4a4e4cd94 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.537560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf6ad-cdbb-4289-b86f-b0c4a4e4cd94 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.538246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4cf6ad-cdbb-4289-b86f-b0c4a4e4cd94 None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.540270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cf6ad-cdbb-4289-b86f-b0c4a4e4cd94 None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:39.542443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4cf6ad-cdbb-4289-b86f-b0c4a4e4cd94 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:39.545125 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 195/398] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:39.547638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d065b57-0c20-4766-b3f4-29e8ab58ef45 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.547638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d065b57-0c20-4766-b3f4-29e8ab58ef45 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.547958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d065b57-0c20-4766-b3f4-29e8ab58ef45 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.550039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 196/399] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:39.551759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d065b57-0c20-4766-b3f4-29e8ab58ef45 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.566573 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdf545-ce70-4cba-9971-8cde2d6471e8 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.598789 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:39.638757 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb78eb4-813a-4c85-ba83-f93309ddb0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.640139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb78eb4-813a-4c85-ba83-f93309ddb0ce None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.640969 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb78eb4-813a-4c85-ba83-f93309ddb0ce None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.641440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb78eb4-813a-4c85-ba83-f93309ddb0ce None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.643270 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb78eb4-813a-4c85-ba83-f93309ddb0ce None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:39.645785 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb78eb4-813a-4c85-ba83-f93309ddb0ce None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:39.648603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 204/400] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:39.650605 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb78eb4-813a-4c85-ba83-f93309ddb0ce None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.659582 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:39.751693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d065b57-0c20-4766-b3f4-29e8ab58ef45 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.801695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481ee29-1767-4f6b-8570-0ec8d95ca247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.802631 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ee29-1767-4f6b-8570-0ec8d95ca247 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.803043 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ee29-1767-4f6b-8570-0ec8d95ca247 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.803890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481ee29-1767-4f6b-8570-0ec8d95ca247 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.819512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481ee29-1767-4f6b-8570-0ec8d95ca247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-b481ee29-1767-4f6b-8570-0ec8d95ca247 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:39.828850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:39.830602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:39.832234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 197/401] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:39.835654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e083b-8bb6-45c1-b63d-320ab5c45887 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.835654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e083b-8bb6-45c1-b63d-320ab5c45887 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.835654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e083b-8bb6-45c1-b63d-320ab5c45887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.861232 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb78eb4-813a-4c85-ba83-f93309ddb0ce None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:39.865368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f96e083b-8bb6-45c1-b63d-320ab5c45887 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:39.867526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f96e083b-8bb6-45c1-b63d-320ab5c45887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:39.913785 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968befb-a5b1-4141-9342-dcf89737caa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:39.915570 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968befb-a5b1-4141-9342-dcf89737caa0 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:39.916041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968befb-a5b1-4141-9342-dcf89737caa0 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:39.916562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d968befb-a5b1-4141-9342-dcf89737caa0 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:39.918257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968befb-a5b1-4141-9342-dcf89737caa0 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:39.920278 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d968befb-a5b1-4141-9342-dcf89737caa0 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:39.923052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 205/402] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:39.924167 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968befb-a5b1-4141-9342-dcf89737caa0 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:39.994548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 198/403] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:39.994548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e083b-8bb6-45c1-b63d-320ab5c45887 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:40.026982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:40.069895 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:40.112046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d968befb-a5b1-4141-9342-dcf89737caa0 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:40.167397 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e98e1-bd2a-4c52-a467-d558ad7b213b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:40.169028 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e98e1-bd2a-4c52-a467-d558ad7b213b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.169544 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e98e1-bd2a-4c52-a467-d558ad7b213b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.170050 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81e98e1-bd2a-4c52-a467-d558ad7b213b None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.171986 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e98e1-bd2a-4c52-a467-d558ad7b213b None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:40.174399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81e98e1-bd2a-4c52-a467-d558ad7b213b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:40.183897 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 206/404] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:40.183897 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e98e1-bd2a-4c52-a467-d558ad7b213b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:40.200011 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e083b-8bb6-45c1-b63d-320ab5c45887 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:40.272692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48a89d-375d-4920-94a4-3883c815df94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:40.273636 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48a89d-375d-4920-94a4-3883c815df94 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.274381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48a89d-375d-4920-94a4-3883c815df94 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.274656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48a89d-375d-4920-94a4-3883c815df94 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.275587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48a89d-375d-4920-94a4-3883c815df94 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:40.276057 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48a89d-375d-4920-94a4-3883c815df94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:40.279079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48a89d-375d-4920-94a4-3883c815df94 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:40.294624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 199/405] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:40.295780 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48a89d-375d-4920-94a4-3883c815df94 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:40.377807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81e98e1-bd2a-4c52-a467-d558ad7b213b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:40.430599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:40.432852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f119d1-400e-4055-bcc8-ab64435b415d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:40.434134 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f119d1-400e-4055-bcc8-ab64435b415d None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.434554 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f119d1-400e-4055-bcc8-ab64435b415d None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.434939 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f119d1-400e-4055-bcc8-ab64435b415d None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/groups/c94793685c0a40978fd3533d7ad62607/roles/293f9e8d2aba452aadef740529c3d498` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.438084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f119d1-400e-4055-bcc8-ab64435b415d None admin] RBAC: Authorizing `identity:create_grant(project_id=d1edf83a1ef145608eee0bc79557f6e5, group_id=c94793685c0a40978fd3533d7ad62607, role_id=293f9e8d2aba452aadef740529c3d498)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:40.439750 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f119d1-400e-4055-bcc8-ab64435b415d None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:40.453146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:40.458263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 207/406] 10.222.0.24 () {58 vars in 1442 bytes} [Sat Jun 4 20:35:40 2022] PUT /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/groups/c94793685c0a40978fd3533d7ad62607/roles/293f9e8d2aba452aadef740529c3d498 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:40.460704 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f119d1-400e-4055-bcc8-ab64435b415d None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:40.466168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48a89d-375d-4920-94a4-3883c815df94 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:40.532890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e940-a8d4-4ba3-8812-c3d613d4af0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:40.534128 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e940-a8d4-4ba3-8812-c3d613d4af0c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.534625 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e940-a8d4-4ba3-8812-c3d613d4af0c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.535117 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764e940-a8d4-4ba3-8812-c3d613d4af0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.557820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764e940-a8d4-4ba3-8812-c3d613d4af0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-0764e940-a8d4-4ba3-8812-c3d613d4af0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:40.571030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:40.572196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:40.573116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:40.582477 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 200/407] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:40.584218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e940-a8d4-4ba3-8812-c3d613d4af0c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:40.619106 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f119d1-400e-4055-bcc8-ab64435b415d None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:40.679308 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b5f611-bbc3-432c-b5d1-1f78a9f35837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:40.681752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5f611-bbc3-432c-b5d1-1f78a9f35837 None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.682204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5f611-bbc3-432c-b5d1-1f78a9f35837 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.682665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b5f611-bbc3-432c-b5d1-1f78a9f35837 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee/groups/c94793685c0a40978fd3533d7ad62607/roles/293f9e8d2aba452aadef740529c3d498` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.686896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5f611-bbc3-432c-b5d1-1f78a9f35837 None admin] RBAC: Authorizing `identity:create_grant(project_id=2614591ccb4e488ba922d8212cdc54ee, group_id=c94793685c0a40978fd3533d7ad62607, role_id=293f9e8d2aba452aadef740529c3d498)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:40.689726 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b5f611-bbc3-432c-b5d1-1f78a9f35837 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:40.716635 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 208/408] 10.222.0.24 () {58 vars in 1442 bytes} [Sat Jun 4 20:35:40 2022] PUT /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee/groups/c94793685c0a40978fd3533d7ad62607/roles/293f9e8d2aba452aadef740529c3d498 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:40.719109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2a912-03ad-4d8d-ba49-9afbefb2377a None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.719558 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2a912-03ad-4d8d-ba49-9afbefb2377a None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.719997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b2a912-03ad-4d8d-ba49-9afbefb2377a None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.722627 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 209/409] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:40.723670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2a912-03ad-4d8d-ba49-9afbefb2377a None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:40.778214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764e940-a8d4-4ba3-8812-c3d613d4af0c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:40.838317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4622ac-0ad1-4258-aa5a-563ece6a22d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:40.839422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4622ac-0ad1-4258-aa5a-563ece6a22d2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.839797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4622ac-0ad1-4258-aa5a-563ece6a22d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.840169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4622ac-0ad1-4258-aa5a-563ece6a22d2 None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.841745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4622ac-0ad1-4258-aa5a-563ece6a22d2 None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:40.843409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4622ac-0ad1-4258-aa5a-563ece6a22d2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:40.852702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 201/410] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:40 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:40.852702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dd718-1a4b-4bd6-82dc-8974531ede0d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:40.852702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dd718-1a4b-4bd6-82dc-8974531ede0d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:40.852702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577dd718-1a4b-4bd6-82dc-8974531ede0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:40.869119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:40.879879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-577dd718-1a4b-4bd6-82dc-8974531ede0d None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:40.883107 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:40.885547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-577dd718-1a4b-4bd6-82dc-8974531ede0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:40.973298 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b2a912-03ad-4d8d-ba49-9afbefb2377a None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.037251 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 202/411] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:41.040501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dd718-1a4b-4bd6-82dc-8974531ede0d None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.050864 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8e31-ef78-4061-b81e-d07d86381883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.052160 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8e31-ef78-4061-b81e-d07d86381883 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.052746 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8e31-ef78-4061-b81e-d07d86381883 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.053264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a8e31-ef78-4061-b81e-d07d86381883 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.054848 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a8e31-ef78-4061-b81e-d07d86381883 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:41.055441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a8e31-ef78-4061-b81e-d07d86381883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:41.058240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373a8e31-ef78-4061-b81e-d07d86381883 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:41.078513 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 210/412] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:41.084017 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8e31-ef78-4061-b81e-d07d86381883 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.283187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577dd718-1a4b-4bd6-82dc-8974531ede0d None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.296156 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a8e31-ef78-4061-b81e-d07d86381883 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.338446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4107d-4f39-48cd-88a9-720deebfa369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.339616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4107d-4f39-48cd-88a9-720deebfa369 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.339902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4107d-4f39-48cd-88a9-720deebfa369 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.340178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4107d-4f39-48cd-88a9-720deebfa369 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.342387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4107d-4f39-48cd-88a9-720deebfa369 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:41.344299 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4107d-4f39-48cd-88a9-720deebfa369 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:41.347037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 203/413] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:41 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:41.349074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4107d-4f39-48cd-88a9-720deebfa369 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.354628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:41.388560 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:41.401536 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357c60e-9baa-4612-ae92-bf956122f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.402851 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357c60e-9baa-4612-ae92-bf956122f5de None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.403357 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357c60e-9baa-4612-ae92-bf956122f5de None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.403849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357c60e-9baa-4612-ae92-bf956122f5de None admin] PATH_INFO: `/v3/roles/member` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.421670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357c60e-9baa-4612-ae92-bf956122f5de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-4357c60e-9baa-4612-ae92-bf956122f5de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:41.438589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:41.439587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:41.440394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:41.446300 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 211/414] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:41.446300 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357c60e-9baa-4612-ae92-bf956122f5de None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.534513 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4107d-4f39-48cd-88a9-720deebfa369 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.579849 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080b926-6084-49d9-851e-a4ebef56bd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.581152 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080b926-6084-49d9-851e-a4ebef56bd80 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.581629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080b926-6084-49d9-851e-a4ebef56bd80 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.582081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080b926-6084-49d9-851e-a4ebef56bd80 None admin] PATH_INFO: `/v3/groups/cf1d0c2392bf42a9b4d81efa80543e62` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.583905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080b926-6084-49d9-851e-a4ebef56bd80 None admin] RBAC: Authorizing `identity:get_group(group_id=cf1d0c2392bf42a9b4d81efa80543e62)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:41.585979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080b926-6084-49d9-851e-a4ebef56bd80 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:41.593015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 204/415] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:41 2022] GET /identity/v3/groups/cf1d0c2392bf42a9b4d81efa80543e62 => generated 229 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:41.594371 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080b926-6084-49d9-851e-a4ebef56bd80 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.636000 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357c60e-9baa-4612-ae92-bf956122f5de None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.675880 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a96d48-a6c6-4cbc-837b-261397e1dcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.676851 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96d48-a6c6-4cbc-837b-261397e1dcc9 None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.677136 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96d48-a6c6-4cbc-837b-261397e1dcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.677418 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a96d48-a6c6-4cbc-837b-261397e1dcc9 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/groups/c94793685c0a40978fd3533d7ad62607/roles/52b41e61eb19402aa67a7defc45d7f5f` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.679849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a96d48-a6c6-4cbc-837b-261397e1dcc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1edf83a1ef145608eee0bc79557f6e5, group_id=c94793685c0a40978fd3533d7ad62607, role_id=52b41e61eb19402aa67a7defc45d7f5f)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:41.681365 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a96d48-a6c6-4cbc-837b-261397e1dcc9 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:41.690017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:41.705345 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 212/416] 10.222.0.24 () {58 vars in 1442 bytes} [Sat Jun 4 20:35:41 2022] PUT /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5/groups/c94793685c0a40978fd3533d7ad62607/roles/52b41e61eb19402aa67a7defc45d7f5f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:35:41.706837 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a96d48-a6c6-4cbc-837b-261397e1dcc9 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:41.742393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080b926-6084-49d9-851e-a4ebef56bd80 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:41.793218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e9afa-2f36-4503-9558-80ec2f7a5a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:41.794330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e9afa-2f36-4503-9558-80ec2f7a5a79 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:41.794841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e9afa-2f36-4503-9558-80ec2f7a5a79 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:41.795327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e9afa-2f36-4503-9558-80ec2f7a5a79 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:41.796361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e9afa-2f36-4503-9558-80ec2f7a5a79 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:41.797107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e9afa-2f36-4503-9558-80ec2f7a5a79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:41.798765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e9afa-2f36-4503-9558-80ec2f7a5a79 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:41.809854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 205/417] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:41.816255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:41.818312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e9afa-2f36-4503-9558-80ec2f7a5a79 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:42.026329 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a96d48-a6c6-4cbc-837b-261397e1dcc9 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:42.074040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e9afa-2f36-4503-9558-80ec2f7a5a79 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:42.134542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:42.152387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b158e2-c93c-4acb-bc70-34467251a9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:42.154088 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b158e2-c93c-4acb-bc70-34467251a9fe None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:42.154623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b158e2-c93c-4acb-bc70-34467251a9fe None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:42.155125 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b158e2-c93c-4acb-bc70-34467251a9fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:42.158512 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375da49-6a50-4e7f-88cb-42a66c6a38b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:42.159418 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375da49-6a50-4e7f-88cb-42a66c6a38b8 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:42.159701 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375da49-6a50-4e7f-88cb-42a66c6a38b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:42.159971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375da49-6a50-4e7f-88cb-42a66c6a38b8 None admin] PATH_INFO: `/v3/projects/a16b8488457e4e38a2b3d336cfdffb59` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:42.161544 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375da49-6a50-4e7f-88cb-42a66c6a38b8 None admin] RBAC: Authorizing `identity:get_project(project_id=a16b8488457e4e38a2b3d336cfdffb59)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:42.165020 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375da49-6a50-4e7f-88cb-42a66c6a38b8 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:42.165555 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 213/418] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:41 2022] GET /identity/v3/projects/a16b8488457e4e38a2b3d336cfdffb59 => generated 344 bytes in 459 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:42.171089 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375da49-6a50-4e7f-88cb-42a66c6a38b8 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:42.312290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b158e2-c93c-4acb-bc70-34467251a9fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:42.314726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b158e2-c93c-4acb-bc70-34467251a9fe None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:42.407770 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375da49-6a50-4e7f-88cb-42a66c6a38b8 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:42.434019 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:42.506040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7a5d8-06ea-4b84-9d1e-0e2850589f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:42.506972 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a5d8-06ea-4b84-9d1e-0e2850589f86 None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:42.507275 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a5d8-06ea-4b84-9d1e-0e2850589f86 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:42.507524 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7a5d8-06ea-4b84-9d1e-0e2850589f86 None admin] PATH_INFO: `/v3/projects/a16b8488457e4e38a2b3d336cfdffb59/groups/cf1d0c2392bf42a9b4d81efa80543e62/roles/f315b062be7e445fa9461a116f9c46ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:42.509797 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7a5d8-06ea-4b84-9d1e-0e2850589f86 None admin] RBAC: Authorizing `identity:create_grant(project_id=a16b8488457e4e38a2b3d336cfdffb59, group_id=cf1d0c2392bf42a9b4d81efa80543e62, role_id=f315b062be7e445fa9461a116f9c46ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:42.511290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7a5d8-06ea-4b84-9d1e-0e2850589f86 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:42.528266 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 206/419] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:42.534103 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b158e2-c93c-4acb-bc70-34467251a9fe None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:42.545403 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 214/420] 10.222.0.24 () {58 vars in 1442 bytes} [Sat Jun 4 20:35:42 2022] PUT /identity/v3/projects/a16b8488457e4e38a2b3d336cfdffb59/groups/cf1d0c2392bf42a9b4d81efa80543e62/roles/f315b062be7e445fa9461a116f9c46ee => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:35:42.577157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:42.716388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b158e2-c93c-4acb-bc70-34467251a9fe None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:42.770441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bad20-a885-4029-84dd-8788cef73be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:42.771364 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bad20-a885-4029-84dd-8788cef73be8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:42.771649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bad20-a885-4029-84dd-8788cef73be8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:42.771925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bad20-a885-4029-84dd-8788cef73be8 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:42.777665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bad20-a885-4029-84dd-8788cef73be8 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:42.779240 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bad20-a885-4029-84dd-8788cef73be8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:42.781606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 207/421] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:42 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:42.788480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7a5d8-06ea-4b84-9d1e-0e2850589f86 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:43.016553 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7a5d8-06ea-4b84-9d1e-0e2850589f86 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:43.081031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e0043-96bb-4421-b18d-b87c4ce692a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:43.082561 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e0043-96bb-4421-b18d-b87c4ce692a9 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:43.083060 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e0043-96bb-4421-b18d-b87c4ce692a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:43.083551 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e0043-96bb-4421-b18d-b87c4ce692a9 None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:43.086043 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e0043-96bb-4421-b18d-b87c4ce692a9 None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:43.089244 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e0043-96bb-4421-b18d-b87c4ce692a9 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:43.093011 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 215/422] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:42 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:43.098705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bad20-a885-4029-84dd-8788cef73be8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:43.265220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:43.268664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bad20-a885-4029-84dd-8788cef73be8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:43.315832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3d4c4d-7871-4609-85b8-50ad228d482f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:43.316542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d4c4d-7871-4609-85b8-50ad228d482f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:43.316826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d4c4d-7871-4609-85b8-50ad228d482f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:43.317103 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3d4c4d-7871-4609-85b8-50ad228d482f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:43.317949 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d4c4d-7871-4609-85b8-50ad228d482f None admin] RBAC: Adding query filter params (group.id=c94793685c0a40978fd3533d7ad62607, role.id=52b41e61eb19402aa67a7defc45d7f5f, scope.project.id=2614591ccb4e488ba922d8212cdc54ee) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:43.318256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d4c4d-7871-4609-85b8-50ad228d482f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:43.319727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3d4c4d-7871-4609-85b8-50ad228d482f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:43.326974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 208/423] 10.222.0.24 () {56 vars in 1376 bytes} [Sat Jun 4 20:35:43 2022] GET /identity/v3/role_assignments?group.id=c94793685c0a40978fd3533d7ad62607&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 611 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:43.691940 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7da43-83d4-4acc-ada9-8d49e3c8abf1 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:43.692781 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7da43-83d4-4acc-ada9-8d49e3c8abf1 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:43.692781 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7da43-83d4-4acc-ada9-8d49e3c8abf1 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:43.694270 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 216/424] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:43.703616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c74775-a163-4740-8971-21552a5f2668 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:43.704582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c74775-a163-4740-8971-21552a5f2668 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:43.705323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c74775-a163-4740-8971-21552a5f2668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:43.737689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a5c74775-a163-4740-8971-21552a5f2668 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:43.740153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a5c74775-a163-4740-8971-21552a5f2668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:43.889265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 209/425] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:43.939949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7da43-83d4-4acc-ada9-8d49e3c8abf1 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:43.948698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca095e-5d37-4d58-86d6-9a0a9eb6c05b None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:43.949755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca095e-5d37-4d58-86d6-9a0a9eb6c05b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:43.950505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca095e-5d37-4d58-86d6-9a0a9eb6c05b None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:43.953996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 210/426] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:43.965182 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d265ea-df15-4280-a938-785fcd26fc2a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:43.966073 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d265ea-df15-4280-a938-785fcd26fc2a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:43.966826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d265ea-df15-4280-a938-785fcd26fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:43.997230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-19d265ea-df15-4280-a938-785fcd26fc2a None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:43.999889 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-19d265ea-df15-4280-a938-785fcd26fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:44.025407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:44.148600 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 211/427] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:44.196588 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7da43-83d4-4acc-ada9-8d49e3c8abf1 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:44.204146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d265ea-df15-4280-a938-785fcd26fc2a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:44.258387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:44.282602 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb7fb-7ba2-463d-b6f5-705d1b24e550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:44.283838 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb7fb-7ba2-463d-b6f5-705d1b24e550 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:44.284336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb7fb-7ba2-463d-b6f5-705d1b24e550 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:44.285026 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22eb7fb-7ba2-463d-b6f5-705d1b24e550 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:44.313515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22eb7fb-7ba2-463d-b6f5-705d1b24e550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-c22eb7fb-7ba2-463d-b6f5-705d1b24e550 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:44.333407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:44.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:44.335209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:44.338623 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 217/428] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:44.348622 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb7fb-7ba2-463d-b6f5-705d1b24e550 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:44.440772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d265ea-df15-4280-a938-785fcd26fc2a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:44.522320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e14542-2001-4d01-ae2b-152f25629ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:44.525031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e14542-2001-4d01-ae2b-152f25629ab7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:44.526941 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e14542-2001-4d01-ae2b-152f25629ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:44.527522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e14542-2001-4d01-ae2b-152f25629ab7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:44.549020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e14542-2001-4d01-ae2b-152f25629ab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:44.553589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:44.560795 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22eb7fb-7ba2-463d-b6f5-705d1b24e550 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-62e14542-2001-4d01-ae2b-152f25629ab7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:44.567893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:44.569996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 04 20:35:44.571726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:44.581048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 212/429] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:35:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:44.583876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e14542-2001-4d01-ae2b-152f25629ab7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:44.632133 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264a63e-b786-4517-a306-32f8858bec20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:44.633476 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a63e-b786-4517-a306-32f8858bec20 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:44.634246 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a63e-b786-4517-a306-32f8858bec20 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:44.634426 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264a63e-b786-4517-a306-32f8858bec20 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:44.635924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264a63e-b786-4517-a306-32f8858bec20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:44.636565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264a63e-b786-4517-a306-32f8858bec20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:44.639256 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264a63e-b786-4517-a306-32f8858bec20 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:44.661108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 218/430] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:44.664085 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264a63e-b786-4517-a306-32f8858bec20 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:44.755131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:44.793102 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e14542-2001-4d01-ae2b-152f25629ab7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:44.851318 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264a63e-b786-4517-a306-32f8858bec20 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:44.867513 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80cf6d-169e-49e9-a5f6-33b5f171115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:44.869226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80cf6d-169e-49e9-a5f6-33b5f171115d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:44.869964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80cf6d-169e-49e9-a5f6-33b5f171115d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:44.870693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80cf6d-169e-49e9-a5f6-33b5f171115d None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:44.873237 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80cf6d-169e-49e9-a5f6-33b5f171115d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:44.874510 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80cf6d-169e-49e9-a5f6-33b5f171115d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:44.877882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd80cf6d-169e-49e9-a5f6-33b5f171115d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:44.900937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 213/431] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:44.906572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80cf6d-169e-49e9-a5f6-33b5f171115d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:44.920074 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c85f3-f307-44e2-9726-06da608eb8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:44.921562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c85f3-f307-44e2-9726-06da608eb8bf None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:44.922288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c85f3-f307-44e2-9726-06da608eb8bf None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:44.922965 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c85f3-f307-44e2-9726-06da608eb8bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:44.988140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:45.072093 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c85f3-f307-44e2-9726-06da608eb8bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:45.073075 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c85f3-f307-44e2-9726-06da608eb8bf None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:45.127180 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80cf6d-169e-49e9-a5f6-33b5f171115d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:45.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c454f50c-0da7-41d1-912d-b9c43ec304ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:45.200270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454f50c-0da7-41d1-912d-b9c43ec304ee None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.200906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454f50c-0da7-41d1-912d-b9c43ec304ee None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.201617 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c454f50c-0da7-41d1-912d-b9c43ec304ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.233876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:45.288914 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 219/432] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:45.291337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c85f3-f307-44e2-9726-06da608eb8bf None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:45.339737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454f50c-0da7-41d1-912d-b9c43ec304ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:45.342311 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c454f50c-0da7-41d1-912d-b9c43ec304ee None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:45.384302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:45.466005 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c85f3-f307-44e2-9726-06da608eb8bf None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:45.527417 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9f1d-c8c7-4947-85e1-ac392cef9165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:45.528301 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9f1d-c8c7-4947-85e1-ac392cef9165 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.528631 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9f1d-c8c7-4947-85e1-ac392cef9165 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.528913 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f9f1d-c8c7-4947-85e1-ac392cef9165 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.530254 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f9f1d-c8c7-4947-85e1-ac392cef9165 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:45.531729 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f9f1d-c8c7-4947-85e1-ac392cef9165 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:45.533751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 214/433] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:45.533928 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 220/434] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:45 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:45.534836 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9f1d-c8c7-4947-85e1-ac392cef9165 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:45.535647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621e569-e15f-4e3f-b015-5521331d58b5 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.536033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621e569-e15f-4e3f-b015-5521331d58b5 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.536472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2621e569-e15f-4e3f-b015-5521331d58b5 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.548688 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 215/435] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:45.548688 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621e569-e15f-4e3f-b015-5521331d58b5 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:45.615489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:45.670832 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f9f1d-c8c7-4947-85e1-ac392cef9165 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:45.687892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2621e569-e15f-4e3f-b015-5521331d58b5 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:45.703923 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:45.713842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5be63-742b-4fcb-98bf-7173599145d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:45.714725 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5be63-742b-4fcb-98bf-7173599145d5 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.715012 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5be63-742b-4fcb-98bf-7173599145d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.715300 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5be63-742b-4fcb-98bf-7173599145d5 None admin] PATH_INFO: `/v3/projects/2614591ccb4e488ba922d8212cdc54ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.716632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5be63-742b-4fcb-98bf-7173599145d5 None admin] RBAC: Authorizing `identity:get_project(project_id=2614591ccb4e488ba922d8212cdc54ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:45.718114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5be63-742b-4fcb-98bf-7173599145d5 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:45.719894 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 221/436] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:45 2022] GET /identity/v3/projects/2614591ccb4e488ba922d8212cdc54ee => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:45.721251 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c7e80-29d3-491a-b2c7-760e35bfb10a None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.721555 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c7e80-29d3-491a-b2c7-760e35bfb10a None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.721818 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c7e80-29d3-491a-b2c7-760e35bfb10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.730801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3741a-1c10-4144-9678-fabd82592957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:45.732290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3741a-1c10-4144-9678-fabd82592957 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.732864 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3741a-1c10-4144-9678-fabd82592957 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.733368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3741a-1c10-4144-9678-fabd82592957 None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.735698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3741a-1c10-4144-9678-fabd82592957 None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:45.738552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc3741a-1c10-4144-9678-fabd82592957 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:45.740090 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-187c7e80-29d3-491a-b2c7-760e35bfb10a None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:45.741355 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-187c7e80-29d3-491a-b2c7-760e35bfb10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:45.747212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 216/437] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:45 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:45.747212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76a1f-d9c7-4dbe-86a2-911e5d18d166 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.747212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76a1f-d9c7-4dbe-86a2-911e5d18d166 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.747212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb76a1f-d9c7-4dbe-86a2-911e5d18d166 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.748311 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 217/438] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:45.749821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76a1f-d9c7-4dbe-86a2-911e5d18d166 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:45.824891 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 222/439] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:45.826334 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c7e80-29d3-491a-b2c7-760e35bfb10a None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:45.867893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb76a1f-d9c7-4dbe-86a2-911e5d18d166 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:45.884743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:45.909521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b6efce-61a4-408a-bbd7-93df8a112e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:45.910397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6efce-61a4-408a-bbd7-93df8a112e6f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.910681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6efce-61a4-408a-bbd7-93df8a112e6f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.910960 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b6efce-61a4-408a-bbd7-93df8a112e6f None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.912183 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6efce-61a4-408a-bbd7-93df8a112e6f None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:45.913695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b6efce-61a4-408a-bbd7-93df8a112e6f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:45.916286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 218/440] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:45 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:45.917376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813c5d-7aaf-461f-8aef-dc4f8460692d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:45.917663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813c5d-7aaf-461f-8aef-dc4f8460692d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:45.917942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd813c5d-7aaf-461f-8aef-dc4f8460692d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:45.936503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-fd813c5d-7aaf-461f-8aef-dc4f8460692d None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:45.937756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-fd813c5d-7aaf-461f-8aef-dc4f8460692d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:45.958778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c7e80-29d3-491a-b2c7-760e35bfb10a None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:45.987331 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:45.999753 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193e40c-103d-4842-b35f-41a48d4a7e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.000471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193e40c-103d-4842-b35f-41a48d4a7e07 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.000755 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193e40c-103d-4842-b35f-41a48d4a7e07 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.001032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193e40c-103d-4842-b35f-41a48d4a7e07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.001898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193e40c-103d-4842-b35f-41a48d4a7e07 None admin] RBAC: Adding query filter params (group.id=c94793685c0a40978fd3533d7ad62607, role.id=293f9e8d2aba452aadef740529c3d498, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:46.002209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193e40c-103d-4842-b35f-41a48d4a7e07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:46.003690 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193e40c-103d-4842-b35f-41a48d4a7e07 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:46.011065 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 223/441] 10.222.0.24 () {56 vars in 1376 bytes} [Sat Jun 4 20:35:45 2022] GET /identity/v3/role_assignments?group.id=c94793685c0a40978fd3533d7ad62607&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=293f9e8d2aba452aadef740529c3d498 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:46.011921 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193e40c-103d-4842-b35f-41a48d4a7e07 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.020002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 219/442] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:46.031358 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd813c5d-7aaf-461f-8aef-dc4f8460692d None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.185442 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193e40c-103d-4842-b35f-41a48d4a7e07 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:46.232691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af6fe3-2dd3-4cfe-a18c-fa755787b575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.233566 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af6fe3-2dd3-4cfe-a18c-fa755787b575 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.233845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af6fe3-2dd3-4cfe-a18c-fa755787b575 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.234121 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af6fe3-2dd3-4cfe-a18c-fa755787b575 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.243003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd813c5d-7aaf-461f-8aef-dc4f8460692d None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:46.251151 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4af6fe3-2dd3-4cfe-a18c-fa755787b575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:46.262176 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-e4af6fe3-2dd3-4cfe-a18c-fa755787b575 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:46.263511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:46.267542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 224/443] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:46.269665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af6fe3-2dd3-4cfe-a18c-fa755787b575 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.313892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e448f9-bcf8-4634-82b9-f9b5d12483f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.314354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e448f9-bcf8-4634-82b9-f9b5d12483f1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.314760 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e448f9-bcf8-4634-82b9-f9b5d12483f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.315185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e448f9-bcf8-4634-82b9-f9b5d12483f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.316231 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e448f9-bcf8-4634-82b9-f9b5d12483f1 None admin] RBAC: Adding query filter params (group.id=c94793685c0a40978fd3533d7ad62607, role.id=293f9e8d2aba452aadef740529c3d498, scope.project.id=2614591ccb4e488ba922d8212cdc54ee) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:46.316724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e448f9-bcf8-4634-82b9-f9b5d12483f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:46.318929 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e448f9-bcf8-4634-82b9-f9b5d12483f1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:46.331355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 220/444] 10.222.0.24 () {56 vars in 1376 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/role_assignments?group.id=c94793685c0a40978fd3533d7ad62607&scope.project.id=2614591ccb4e488ba922d8212cdc54ee&role.id=293f9e8d2aba452aadef740529c3d498 => generated 611 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:46.332351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e448f9-bcf8-4634-82b9-f9b5d12483f1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.368922 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:46.472738 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4af6fe3-2dd3-4cfe-a18c-fa755787b575 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:46.525869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e448f9-bcf8-4634-82b9-f9b5d12483f1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:46.530706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92addaa-9017-46ed-9585-2420065af5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.531980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92addaa-9017-46ed-9585-2420065af5de None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.532300 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92addaa-9017-46ed-9585-2420065af5de None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.532936 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92addaa-9017-46ed-9585-2420065af5de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.557287 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92addaa-9017-46ed-9585-2420065af5de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-a92addaa-9017-46ed-9585-2420065af5de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:46.572421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:46.573632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:35:46.574477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:46.575095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 225/445] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:46.578814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb64504-8feb-41cf-a9e0-3d64e9919c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.579518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb64504-8feb-41cf-a9e0-3d64e9919c4d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.579804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb64504-8feb-41cf-a9e0-3d64e9919c4d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.580082 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb64504-8feb-41cf-a9e0-3d64e9919c4d None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.580948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb64504-8feb-41cf-a9e0-3d64e9919c4d None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:46.581259 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb64504-8feb-41cf-a9e0-3d64e9919c4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:46.582751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb64504-8feb-41cf-a9e0-3d64e9919c4d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:46.584386 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92addaa-9017-46ed-9585-2420065af5de None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.598078 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 221/446] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:46.606342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb64504-8feb-41cf-a9e0-3d64e9919c4d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.680115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:46.782981 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92addaa-9017-46ed-9585-2420065af5de None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:46.803245 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:46.804646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb64504-8feb-41cf-a9e0-3d64e9919c4d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:46.850667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8bb5a-d848-45f1-a900-37ceba8f6447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.851560 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8bb5a-d848-45f1-a900-37ceba8f6447 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.852100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8bb5a-d848-45f1-a900-37ceba8f6447 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.852608 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef8bb5a-d848-45f1-a900-37ceba8f6447 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.853917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8bb5a-d848-45f1-a900-37ceba8f6447 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:46.854463 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8bb5a-d848-45f1-a900-37ceba8f6447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:46.857113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef8bb5a-d848-45f1-a900-37ceba8f6447 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:46.866406 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66734d52-f6fa-4271-8629-a9c48f65a6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:46.867509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66734d52-f6fa-4271-8629-a9c48f65a6ff None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:46.868006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66734d52-f6fa-4271-8629-a9c48f65a6ff None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:46.868533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66734d52-f6fa-4271-8629-a9c48f65a6ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:46.870706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 226/447] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:46.878176 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8bb5a-d848-45f1-a900-37ceba8f6447 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:46.965181 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66734d52-f6fa-4271-8629-a9c48f65a6ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:46.967981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66734d52-f6fa-4271-8629-a9c48f65a6ff None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:47.003881 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef8bb5a-d848-45f1-a900-37ceba8f6447 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:47.042954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:47.044682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d309b3e-af59-4d98-af24-859370216012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:47.045443 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d309b3e-af59-4d98-af24-859370216012 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.045843 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d309b3e-af59-4d98-af24-859370216012 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.046280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d309b3e-af59-4d98-af24-859370216012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.099438 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:47.134656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d309b3e-af59-4d98-af24-859370216012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:47.135282 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 222/448] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:47.137410 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d309b3e-af59-4d98-af24-859370216012 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:47.141638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66734d52-f6fa-4271-8629-a9c48f65a6ff None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:47.262795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66734d52-f6fa-4271-8629-a9c48f65a6ff None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:47.285214 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 227/449] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:47.292144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d309b3e-af59-4d98-af24-859370216012 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:47.311671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca1662-7474-4306-9207-d0ada1c3b761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:47.313054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1662-7474-4306-9207-d0ada1c3b761 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.313378 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1662-7474-4306-9207-d0ada1c3b761 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.313758 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1662-7474-4306-9207-d0ada1c3b761 None admin] PATH_INFO: `/v3/projects/d1edf83a1ef145608eee0bc79557f6e5` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.315357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca1662-7474-4306-9207-d0ada1c3b761 None admin] RBAC: Authorizing `identity:get_project(project_id=d1edf83a1ef145608eee0bc79557f6e5)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:47.317146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ca1662-7474-4306-9207-d0ada1c3b761 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:47.319399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 223/450] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:47 2022] GET /identity/v3/projects/d1edf83a1ef145608eee0bc79557f6e5 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:47.325864 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca1662-7474-4306-9207-d0ada1c3b761 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:47.337589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:47.403641 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:47.446840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d309b3e-af59-4d98-af24-859370216012 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:47.463548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca1662-7474-4306-9207-d0ada1c3b761 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:47.486744 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a413364-4980-47dc-8ce1-ecd8130542da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:47.487863 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a413364-4980-47dc-8ce1-ecd8130542da None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.488217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a413364-4980-47dc-8ce1-ecd8130542da None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.488595 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a413364-4980-47dc-8ce1-ecd8130542da None admin] PATH_INFO: `/v3/projects/a16b8488457e4e38a2b3d336cfdffb59` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.490222 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a413364-4980-47dc-8ce1-ecd8130542da None admin] RBAC: Authorizing `identity:get_project(project_id=a16b8488457e4e38a2b3d336cfdffb59)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:47.492008 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a413364-4980-47dc-8ce1-ecd8130542da None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:47.494423 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 228/451] 10.222.0.24 () {56 vars in 1186 bytes} [Sat Jun 4 20:35:47 2022] GET /identity/v3/projects/a16b8488457e4e38a2b3d336cfdffb59 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:47.500988 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a413364-4980-47dc-8ce1-ecd8130542da None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:47.502332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38200b83-b9f3-4839-902a-a849ba3e15ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:47.503216 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38200b83-b9f3-4839-902a-a849ba3e15ea None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.503510 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38200b83-b9f3-4839-902a-a849ba3e15ea None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.503788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38200b83-b9f3-4839-902a-a849ba3e15ea None admin] PATH_INFO: `/v3/groups/c94793685c0a40978fd3533d7ad62607` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.505107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38200b83-b9f3-4839-902a-a849ba3e15ea None admin] RBAC: Authorizing `identity:get_group(group_id=c94793685c0a40978fd3533d7ad62607)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:47.506651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38200b83-b9f3-4839-902a-a849ba3e15ea None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:47.508546 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 224/452] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:47 2022] GET /identity/v3/groups/c94793685c0a40978fd3533d7ad62607 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:47.515702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38200b83-b9f3-4839-902a-a849ba3e15ea None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:47.609064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:47.642186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38200b83-b9f3-4839-902a-a849ba3e15ea None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:47.650151 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a413364-4980-47dc-8ce1-ecd8130542da None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:47.679426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae211-30e7-4967-aa4e-457351a77136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:47.680131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae211-30e7-4967-aa4e-457351a77136 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.680493 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae211-30e7-4967-aa4e-457351a77136 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.680725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66ae211-30e7-4967-aa4e-457351a77136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.681589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ae211-30e7-4967-aa4e-457351a77136 None admin] RBAC: Adding query filter params (group.id=c94793685c0a40978fd3533d7ad62607, role.id=52b41e61eb19402aa67a7defc45d7f5f, scope.project.id=d1edf83a1ef145608eee0bc79557f6e5) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:47.681905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ae211-30e7-4967-aa4e-457351a77136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:47.683452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66ae211-30e7-4967-aa4e-457351a77136 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:47.690257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 225/453] 10.222.0.24 () {56 vars in 1376 bytes} [Sat Jun 4 20:35:47 2022] GET /identity/v3/role_assignments?group.id=c94793685c0a40978fd3533d7ad62607&scope.project.id=d1edf83a1ef145608eee0bc79557f6e5&role.id=52b41e61eb19402aa67a7defc45d7f5f => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:47.712501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e47ea-73e5-42a1-aab1-bd4036775fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:47.714029 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e47ea-73e5-42a1-aab1-bd4036775fb5 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.714485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e47ea-73e5-42a1-aab1-bd4036775fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.714937 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e47ea-73e5-42a1-aab1-bd4036775fb5 None admin] PATH_INFO: `/v3/groups/cf1d0c2392bf42a9b4d81efa80543e62` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.717321 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e47ea-73e5-42a1-aab1-bd4036775fb5 None admin] RBAC: Authorizing `identity:get_group(group_id=cf1d0c2392bf42a9b4d81efa80543e62)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:47.720245 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e47ea-73e5-42a1-aab1-bd4036775fb5 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:47.723579 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 229/454] 10.222.0.24 () {56 vars in 1180 bytes} [Sat Jun 4 20:35:47 2022] GET /identity/v3/groups/cf1d0c2392bf42a9b4d81efa80543e62 => generated 229 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:47.731190 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae211-30e7-4967-aa4e-457351a77136 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:47.919320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66ae211-30e7-4967-aa4e-457351a77136 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:47.966826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d3db8-e080-4ea3-bcf3-5f6fc19c6ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:47.967856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d3db8-e080-4ea3-bcf3-5f6fc19c6ecb None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:47.968314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d3db8-e080-4ea3-bcf3-5f6fc19c6ecb None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:47.968803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d3db8-e080-4ea3-bcf3-5f6fc19c6ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:47.969893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d3db8-e080-4ea3-bcf3-5f6fc19c6ecb None admin] RBAC: Adding query filter params (group.id=cf1d0c2392bf42a9b4d81efa80543e62, role.id=f315b062be7e445fa9461a116f9c46ee, scope.project.id=a16b8488457e4e38a2b3d336cfdffb59) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:47.970274 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d3db8-e080-4ea3-bcf3-5f6fc19c6ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:47.972115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92d3db8-e080-4ea3-bcf3-5f6fc19c6ecb None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:47.981130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 226/455] 10.222.0.24 () {56 vars in 1376 bytes} [Sat Jun 4 20:35:47 2022] GET /identity/v3/role_assignments?group.id=cf1d0c2392bf42a9b4d81efa80543e62&scope.project.id=a16b8488457e4e38a2b3d336cfdffb59&role.id=f315b062be7e445fa9461a116f9c46ee => generated 611 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:51.301929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0054f-a366-4531-8d27-27535ecba4b3 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:51.301929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0054f-a366-4531-8d27-27535ecba4b3 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:51.301929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0054f-a366-4531-8d27-27535ecba4b3 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:51.306087 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 230/456] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:51.312357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a996b-3a9e-4775-9841-ec35b002eb2e None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:51.313281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a996b-3a9e-4775-9841-ec35b002eb2e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:51.313281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12a996b-3a9e-4775-9841-ec35b002eb2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:51.318856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:51.334600 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c12a996b-3a9e-4775-9841-ec35b002eb2e None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:51.335843 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c12a996b-3a9e-4775-9841-ec35b002eb2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:51.428781 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 227/457] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:51.455380 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0054f-a366-4531-8d27-27535ecba4b3 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:51.470149 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:51.583429 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0054f-a366-4531-8d27-27535ecba4b3 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:51.624931 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddf5b5-db49-437c-9e26-eb7b914ab548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:51.625775 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddf5b5-db49-437c-9e26-eb7b914ab548 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:51.626059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddf5b5-db49-437c-9e26-eb7b914ab548 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:51.626335 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddf5b5-db49-437c-9e26-eb7b914ab548 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:51.639469 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddf5b5-db49-437c-9e26-eb7b914ab548 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:51.641376 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddf5b5-db49-437c-9e26-eb7b914ab548 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-27ddf5b5-db49-437c-9e26-eb7b914ab548 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:51.661883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:51.663642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:51.665550 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:51.665550 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:51.665550 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:51.665550 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:51.665550 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 231/458] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:51.671029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a996b-3a9e-4775-9841-ec35b002eb2e None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:51.855371 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12a996b-3a9e-4775-9841-ec35b002eb2e None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:51.922765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:51.931743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65344df-93c3-4ddd-86ba-507735674c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:51.932962 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65344df-93c3-4ddd-86ba-507735674c99 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:51.933774 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65344df-93c3-4ddd-86ba-507735674c99 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:51.934474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65344df-93c3-4ddd-86ba-507735674c99 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:51.935927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65344df-93c3-4ddd-86ba-507735674c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:51.936511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65344df-93c3-4ddd-86ba-507735674c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:51.939083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65344df-93c3-4ddd-86ba-507735674c99 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:51.964400 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 228/459] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:51.970085 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddf5b5-db49-437c-9e26-eb7b914ab548 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:52.048420 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:52.097510 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddf5b5-db49-437c-9e26-eb7b914ab548 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:52.122268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611f4a9-5c00-434c-81cd-f694743a16cf None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.122902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611f4a9-5c00-434c-81cd-f694743a16cf None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.123389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611f4a9-5c00-434c-81cd-f694743a16cf None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.125495 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 229/460] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:35:52.131535 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ef05a-5b2b-4e12-8d0a-49074f405512 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.132161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ef05a-5b2b-4e12-8d0a-49074f405512 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.132704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ef05a-5b2b-4e12-8d0a-49074f405512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.138595 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9571b-0eca-4152-b1a8-d60772b3176c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:52.139291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9571b-0eca-4152-b1a8-d60772b3176c None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.139577 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9571b-0eca-4152-b1a8-d60772b3176c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.139854 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a9571b-0eca-4152-b1a8-d60772b3176c None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.140977 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9571b-0eca-4152-b1a8-d60772b3176c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:52.142481 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a9571b-0eca-4152-b1a8-d60772b3176c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:52.154299 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-090ef05a-5b2b-4e12-8d0a-49074f405512 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:52.156405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-090ef05a-5b2b-4e12-8d0a-49074f405512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:52.172054 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 232/461] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:51 2022] POST /identity/v3/users => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:52.261466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 230/462] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:52.291827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9571b-0eca-4152-b1a8-d60772b3176c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:52.434953 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a9571b-0eca-4152-b1a8-d60772b3176c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:52.457270 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:52.482083 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2560c79-20e4-4483-a2e3-b321ec10cb6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:52.482957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2560c79-20e4-4483-a2e3-b321ec10cb6b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.483244 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2560c79-20e4-4483-a2e3-b321ec10cb6b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.483523 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2560c79-20e4-4483-a2e3-b321ec10cb6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.498090 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2560c79-20e4-4483-a2e3-b321ec10cb6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:52.499655 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2560c79-20e4-4483-a2e3-b321ec10cb6b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-a2560c79-20e4-4483-a2e3-b321ec10cb6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:52.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:52.525146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:52.525973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:52.525973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:52.525973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:52.525973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:52.525973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 233/463] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:52.533180 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ef05a-5b2b-4e12-8d0a-49074f405512 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:52.618380 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4640b5-caa6-4f9d-816d-20fee5ba6707 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.618845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4640b5-caa6-4f9d-816d-20fee5ba6707 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.619329 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4640b5-caa6-4f9d-816d-20fee5ba6707 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.628609 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 234/464] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:52.631502 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b1b1c-64cc-438b-950d-be12ca12d7b0 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.631971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b1b1c-64cc-438b-950d-be12ca12d7b0 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.632487 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b1b1c-64cc-438b-950d-be12ca12d7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.665669 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-f24b1b1c-64cc-438b-950d-be12ca12d7b0 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:52.667651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-f24b1b1c-64cc-438b-950d-be12ca12d7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:52.674644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ef05a-5b2b-4e12-8d0a-49074f405512 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:52.710451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:52.727358 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a91bf-bba1-4353-a057-07da82ec880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:52.728063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a91bf-bba1-4353-a057-07da82ec880c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.728351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a91bf-bba1-4353-a057-07da82ec880c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.728669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a91bf-bba1-4353-a057-07da82ec880c None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.729542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a91bf-bba1-4353-a057-07da82ec880c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:52.729859 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a91bf-bba1-4353-a057-07da82ec880c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:52.731347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a91bf-bba1-4353-a057-07da82ec880c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:52.746334 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 231/465] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:52.751952 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a91bf-bba1-4353-a057-07da82ec880c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:52.857584 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 235/466] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:35:52.891636 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a91bf-bba1-4353-a057-07da82ec880c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:52.904076 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b1b1c-64cc-438b-950d-be12ca12d7b0 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:52.936048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae224af-10c8-498f-b841-4ed91d170424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:52.936793 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae224af-10c8-498f-b841-4ed91d170424 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:52.937084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae224af-10c8-498f-b841-4ed91d170424 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:52.937362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae224af-10c8-498f-b841-4ed91d170424 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:52.938098 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae224af-10c8-498f-b841-4ed91d170424 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:52.939637 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae224af-10c8-498f-b841-4ed91d170424 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:52.964876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 232/467] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:52 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:35:53.064288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:53.072787 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b1b1c-64cc-438b-950d-be12ca12d7b0 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:53.073414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b63e-30ab-4ee7-826e-14cf921207a9 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.073714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b63e-30ab-4ee7-826e-14cf921207a9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.073997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60b63e-30ab-4ee7-826e-14cf921207a9 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.075961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 233/468] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:53.081861 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e93a3-e327-4573-ab45-36c8d2717a13 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.082163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e93a3-e327-4573-ab45-36c8d2717a13 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.082483 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e93a3-e327-4573-ab45-36c8d2717a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.104925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-ef9e93a3-e327-4573-ab45-36c8d2717a13 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:53.105692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ef9e93a3-e327-4573-ab45-36c8d2717a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:53.145435 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048c123-f175-44af-b921-75aff9c1732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:53.146041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:53.148665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048c123-f175-44af-b921-75aff9c1732a None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.149531 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048c123-f175-44af-b921-75aff9c1732a None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.150268 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048c123-f175-44af-b921-75aff9c1732a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.177630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048c123-f175-44af-b921-75aff9c1732a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:53.181862 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048c123-f175-44af-b921-75aff9c1732a None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-b048c123-f175-44af-b921-75aff9c1732a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:53.207882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:53.209840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:53.212625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:53.212625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:53.212625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:53.212625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:53.212625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 236/469] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:53.224625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048c123-f175-44af-b921-75aff9c1732a None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:53.228921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 234/470] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:53.253939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e93a3-e327-4573-ab45-36c8d2717a13 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:53.378293 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048c123-f175-44af-b921-75aff9c1732a None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:53.442167 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d097c-ad1c-4671-9799-4fe2aeae6fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:53.444044 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d097c-ad1c-4671-9799-4fe2aeae6fc4 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.445508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d097c-ad1c-4671-9799-4fe2aeae6fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.445508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d097c-ad1c-4671-9799-4fe2aeae6fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.446806 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d097c-ad1c-4671-9799-4fe2aeae6fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:53.447329 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d097c-ad1c-4671-9799-4fe2aeae6fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:53.449887 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d097c-ad1c-4671-9799-4fe2aeae6fc4 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:53.468835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e93a3-e327-4573-ab45-36c8d2717a13 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:53.484585 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 237/471] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:53.491857 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d097c-ad1c-4671-9799-4fe2aeae6fc4 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:53.517896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:53.558834 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bed4c-5ff2-4768-ba6a-a41056b539a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:53.561134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bed4c-5ff2-4768-ba6a-a41056b539a7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.561845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bed4c-5ff2-4768-ba6a-a41056b539a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.562665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bed4c-5ff2-4768-ba6a-a41056b539a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.583143 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bed4c-5ff2-4768-ba6a-a41056b539a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:53.586354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bed4c-5ff2-4768-ba6a-a41056b539a7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-ed8bed4c-5ff2-4768-ba6a-a41056b539a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:53.624278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:53.626054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:53.627702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:53.627702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:53.627702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:53.627702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:53.637093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 235/472] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:53.642235 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bed4c-5ff2-4768-ba6a-a41056b539a7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:53.682109 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:53.700961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d097c-ad1c-4671-9799-4fe2aeae6fc4 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:53.765089 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf2ad4-bd27-432e-995f-eb1a0fe2509e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:53.766426 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf2ad4-bd27-432e-995f-eb1a0fe2509e None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.766902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf2ad4-bd27-432e-995f-eb1a0fe2509e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.767368 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf2ad4-bd27-432e-995f-eb1a0fe2509e None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.768666 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf2ad4-bd27-432e-995f-eb1a0fe2509e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:53.771357 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf2ad4-bd27-432e-995f-eb1a0fe2509e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:53.809040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 238/473] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:53 2022] POST /identity/v3/users => generated 248 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:53.841522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bed4c-5ff2-4768-ba6a-a41056b539a7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:53.888168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a1cc2-7aec-4412-a435-3a577f01f6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:53.888967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a1cc2-7aec-4412-a435-3a577f01f6eb None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:53.889281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a1cc2-7aec-4412-a435-3a577f01f6eb None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:53.889519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a1cc2-7aec-4412-a435-3a577f01f6eb None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:53.890623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a1cc2-7aec-4412-a435-3a577f01f6eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:53.890933 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a1cc2-7aec-4412-a435-3a577f01f6eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:53.892420 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a1cc2-7aec-4412-a435-3a577f01f6eb None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:53.908481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 236/474] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:53.917786 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf2ad4-bd27-432e-995f-eb1a0fe2509e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:54.064194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:54.147602 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf2ad4-bd27-432e-995f-eb1a0fe2509e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:54.204831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f4f3f5-912c-4aad-8394-98f048c072d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:54.205909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4f3f5-912c-4aad-8394-98f048c072d1 None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:54.206354 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4f3f5-912c-4aad-8394-98f048c072d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:54.206804 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f4f3f5-912c-4aad-8394-98f048c072d1 None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:54.207950 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4f3f5-912c-4aad-8394-98f048c072d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:54.210500 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f4f3f5-912c-4aad-8394-98f048c072d1 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:54.245010 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 239/475] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:35:53 2022] POST /identity/v3/users => generated 249 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:35:55.594646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c914e-783e-41f9-b869-2c9637e44584 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:55.594646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c914e-783e-41f9-b869-2c9637e44584 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:55.594646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292c914e-783e-41f9-b869-2c9637e44584 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:55.595828 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 237/476] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:55.602752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a52cd9-18a1-4bdf-816e-959b6567539b None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:55.603781 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a52cd9-18a1-4bdf-816e-959b6567539b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:55.604275 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a52cd9-18a1-4bdf-816e-959b6567539b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:55.623525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-83a52cd9-18a1-4bdf-816e-959b6567539b None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:55.625255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-83a52cd9-18a1-4bdf-816e-959b6567539b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:55.669444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec818-8bcf-46d0-98d9-842155ad2e0b None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:55.669737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec818-8bcf-46d0-98d9-842155ad2e0b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:55.670283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ec818-8bcf-46d0-98d9-842155ad2e0b None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:55.672223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 238/477] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:55.678497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada4bc-2341-423f-b6fc-0d374f268936 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:55.679035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada4bc-2341-423f-b6fc-0d374f268936 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:55.679631 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ada4bc-2341-423f-b6fc-0d374f268936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:55.699108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-04ada4bc-2341-423f-b6fc-0d374f268936 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:55.700872 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-04ada4bc-2341-423f-b6fc-0d374f268936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:55.738097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 240/478] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:55.764118 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a52cd9-18a1-4bdf-816e-959b6567539b None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:55.779682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 239/479] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:55.806406 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada4bc-2341-423f-b6fc-0d374f268936 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:55.820924 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:55.858422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:55.932046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ada4bc-2341-423f-b6fc-0d374f268936 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:55.959091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a52cd9-18a1-4bdf-816e-959b6567539b None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:55.975647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd08756-3532-4f50-8253-3542121f7dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:55.977837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd08756-3532-4f50-8253-3542121f7dd5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:55.978401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd08756-3532-4f50-8253-3542121f7dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:55.978870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd08756-3532-4f50-8253-3542121f7dd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:55.993174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd08756-3532-4f50-8253-3542121f7dd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-1fd08756-3532-4f50-8253-3542121f7dd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:56.002248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:56.003232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:35:56.004020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:56.006946 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 240/480] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:35:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:56.013259 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd08756-3532-4f50-8253-3542121f7dd5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.025368 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820fa4b-a19d-44e0-a434-32ee9a2c5256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.026212 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820fa4b-a19d-44e0-a434-32ee9a2c5256 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.027259 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820fa4b-a19d-44e0-a434-32ee9a2c5256 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.027567 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820fa4b-a19d-44e0-a434-32ee9a2c5256 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.045062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820fa4b-a19d-44e0-a434-32ee9a2c5256 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-7820fa4b-a19d-44e0-a434-32ee9a2c5256 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:56.057130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:56.058099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:35:56.058865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:56.064564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 241/481] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:35:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:56.066235 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820fa4b-a19d-44e0-a434-32ee9a2c5256 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.124736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:56.169206 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd08756-3532-4f50-8253-3542121f7dd5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.191742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820fa4b-a19d-44e0-a434-32ee9a2c5256 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.206913 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:56.214416 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c130-6005-4947-9470-9f5da5ef9190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.215506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c130-6005-4947-9470-9f5da5ef9190 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.215990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c130-6005-4947-9470-9f5da5ef9190 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.216594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c130-6005-4947-9470-9f5da5ef9190 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.217615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7c130-6005-4947-9470-9f5da5ef9190 None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:56.218128 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7c130-6005-4947-9470-9f5da5ef9190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:56.219891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7c130-6005-4947-9470-9f5da5ef9190 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:56.231993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 241/482] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:56.237342 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9d1f8-ab78-4b93-817b-059c3575723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.237583 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c130-6005-4947-9470-9f5da5ef9190 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.238064 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9d1f8-ab78-4b93-817b-059c3575723a None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.238351 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9d1f8-ab78-4b93-817b-059c3575723a None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.238634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9d1f8-ab78-4b93-817b-059c3575723a None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.239525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9d1f8-ab78-4b93-817b-059c3575723a None admin] RBAC: Adding query filter params (name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:56.239841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9d1f8-ab78-4b93-817b-059c3575723a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:56.241340 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9d1f8-ab78-4b93-817b-059c3575723a None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:56.255841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 242/483] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:56.260394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9d1f8-ab78-4b93-817b-059c3575723a None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.400872 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9d1f8-ab78-4b93-817b-059c3575723a None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.442190 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb05eb-813c-4da3-acc0-9f901bc5dd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.443295 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb05eb-813c-4da3-acc0-9f901bc5dd97 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.443723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb05eb-813c-4da3-acc0-9f901bc5dd97 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.444138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb05eb-813c-4da3-acc0-9f901bc5dd97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.447044 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c130-6005-4947-9470-9f5da5ef9190 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.457689 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb05eb-813c-4da3-acc0-9f901bc5dd97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:56.459540 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb05eb-813c-4da3-acc0-9f901bc5dd97 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-16eb05eb-813c-4da3-acc0-9f901bc5dd97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:56.481829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:56.482737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:56.483562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:56.483562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:56.483562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:56.483562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:56.490446 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 243/484] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:56.493203 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb05eb-813c-4da3-acc0-9f901bc5dd97 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.497196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:56.503434 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d421fb-45ec-415e-8427-318b7f2fdd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.504329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d421fb-45ec-415e-8427-318b7f2fdd7c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.504724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d421fb-45ec-415e-8427-318b7f2fdd7c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.505070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d421fb-45ec-415e-8427-318b7f2fdd7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.518031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d421fb-45ec-415e-8427-318b7f2fdd7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:56.519647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d421fb-45ec-415e-8427-318b7f2fdd7c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:56.541462 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-56d421fb-45ec-415e-8427-318b7f2fdd7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:56.541628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:56.543239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:56.545166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:56.545166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:56.545166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:56.545166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:56.546632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 242/485] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:56.547593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d421fb-45ec-415e-8427-318b7f2fdd7c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.626957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb05eb-813c-4da3-acc0-9f901bc5dd97 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.673070 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f689924-24e7-4b93-aceb-d8561884e9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.673836 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f689924-24e7-4b93-aceb-d8561884e9a0 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.674222 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f689924-24e7-4b93-aceb-d8561884e9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.674380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d421fb-45ec-415e-8427-318b7f2fdd7c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.675099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f689924-24e7-4b93-aceb-d8561884e9a0 None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.675599 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f689924-24e7-4b93-aceb-d8561884e9a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:56.676039 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f689924-24e7-4b93-aceb-d8561884e9a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:56.677922 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f689924-24e7-4b93-aceb-d8561884e9a0 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:56.699632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 244/486] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:56.701169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f689924-24e7-4b93-aceb-d8561884e9a0 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.716336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2f9a5-4992-4f6b-8ceb-14c770480653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.717194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f9a5-4992-4f6b-8ceb-14c770480653 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.717485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f9a5-4992-4f6b-8ceb-14c770480653 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.717765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a2f9a5-4992-4f6b-8ceb-14c770480653 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.718549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2f9a5-4992-4f6b-8ceb-14c770480653 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:56.718930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2f9a5-4992-4f6b-8ceb-14c770480653 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:56.720638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a2f9a5-4992-4f6b-8ceb-14c770480653 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:56.829189 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:56.848940 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f689924-24e7-4b93-aceb-d8561884e9a0 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:56.876782 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 243/487] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:56.882748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2f9a5-4992-4f6b-8ceb-14c770480653 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.901014 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8870d-8925-4222-929b-e119f8ca8e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:56.901855 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8870d-8925-4222-929b-e119f8ca8e73 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:56.902316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8870d-8925-4222-929b-e119f8ca8e73 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:56.902723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8870d-8925-4222-929b-e119f8ca8e73 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:56.912619 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8870d-8925-4222-929b-e119f8ca8e73 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:56.914960 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8870d-8925-4222-929b-e119f8ca8e73 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-14c8870d-8925-4222-929b-e119f8ca8e73 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:35:56.938369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:56.939305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:56.946127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:56.946127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:56.946127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:35:56.946127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:35:56.946127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:35:56.946127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:35:56.946127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:35:56.946127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:35:56.946127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:35:56.946127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:56.946127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 245/488] 10.222.0.24 () {56 vars in 1093 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:56.948487 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8870d-8925-4222-929b-e119f8ca8e73 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:56.949198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:57.030123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a2f9a5-4992-4f6b-8ceb-14c770480653 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.076276 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64e42-7b63-4355-b0ab-e65e5d271279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.077601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64e42-7b63-4355-b0ab-e65e5d271279 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.078129 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64e42-7b63-4355-b0ab-e65e5d271279 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.078611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe64e42-7b63-4355-b0ab-e65e5d271279 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.088882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe64e42-7b63-4355-b0ab-e65e5d271279 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:57.090818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe64e42-7b63-4355-b0ab-e65e5d271279 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-bbe64e42-7b63-4355-b0ab-e65e5d271279 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:35:57.123895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:57.125964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:57.127714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:57.127714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:57.127714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:35:57.127714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:35:57.127714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:35:57.127714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:35:57.127714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:35:57.127714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:35:57.127714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:35:57.127714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:57.140961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 244/489] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:57.144335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64e42-7b63-4355-b0ab-e65e5d271279 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:57.280426 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8870d-8925-4222-929b-e119f8ca8e73 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.282705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe64e42-7b63-4355-b0ab-e65e5d271279 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.285705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:57.325482 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3bc26-1165-4cbb-b33e-06742dc089b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.326192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3bc26-1165-4cbb-b33e-06742dc089b9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.326484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3bc26-1165-4cbb-b33e-06742dc089b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.326759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3bc26-1165-4cbb-b33e-06742dc089b9 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.327668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3bc26-1165-4cbb-b33e-06742dc089b9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:57.327981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3bc26-1165-4cbb-b33e-06742dc089b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:57.329574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e3bc26-1165-4cbb-b33e-06742dc089b9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:57.365230 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec916d-d574-400c-a1b3-de2d48088f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.366940 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec916d-d574-400c-a1b3-de2d48088f9d None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.368693 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec916d-d574-400c-a1b3-de2d48088f9d None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.369518 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dec916d-d574-400c-a1b3-de2d48088f9d None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.371518 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec916d-d574-400c-a1b3-de2d48088f9d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:57.372452 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec916d-d574-400c-a1b3-de2d48088f9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:57.375599 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dec916d-d574-400c-a1b3-de2d48088f9d None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:57.376499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 245/490] 10.222.0.24 () {56 vars in 1137 bytes} [Sat Jun 4 20:35:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:57.386050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3bc26-1165-4cbb-b33e-06742dc089b9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:57.473431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 246/491] 10.222.0.24 () {56 vars in 1133 bytes} [Sat Jun 4 20:35:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 520 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:35:57.478786 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec916d-d574-400c-a1b3-de2d48088f9d None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:57.485366 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:57.507065 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3bc26-1165-4cbb-b33e-06742dc089b9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.551897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468a88d-6650-4ced-952c-d41e9037d2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.553029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a88d-6650-4ced-952c-d41e9037d2bd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.553554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a88d-6650-4ced-952c-d41e9037d2bd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.554013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468a88d-6650-4ced-952c-d41e9037d2bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.593940 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:57.644840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468a88d-6650-4ced-952c-d41e9037d2bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:57.646916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468a88d-6650-4ced-952c-d41e9037d2bd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:57.712462 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dec916d-d574-400c-a1b3-de2d48088f9d None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:57.787749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f0e27-8932-4ce4-a310-87387c4fe147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:57.789040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f0e27-8932-4ce4-a310-87387c4fe147 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:57.790257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f0e27-8932-4ce4-a310-87387c4fe147 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:57.790758 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f0e27-8932-4ce4-a310-87387c4fe147 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:57.843957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 246/492] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:35:57.850609 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468a88d-6650-4ced-952c-d41e9037d2bd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:57.936312 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f0e27-8932-4ce4-a310-87387c4fe147 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:57.938039 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f0e27-8932-4ce4-a310-87387c4fe147 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:57.942692 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:57.976083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:58.034148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468a88d-6650-4ced-952c-d41e9037d2bd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:58.090905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845cdba-316a-4654-9013-f67404f17ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:58.092032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845cdba-316a-4654-9013-f67404f17ec5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.092564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845cdba-316a-4654-9013-f67404f17ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.093052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845cdba-316a-4654-9013-f67404f17ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.093818 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 247/493] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:35:58.095406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151cbad-12ff-483a-81d6-21c52d5c5371 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.095813 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151cbad-12ff-483a-81d6-21c52d5c5371 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.096204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6151cbad-12ff-483a-81d6-21c52d5c5371 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.097801 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 248/494] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:58.099431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a697f90-3278-42b1-8a07-9fa26fe9cb72 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.099806 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a697f90-3278-42b1-8a07-9fa26fe9cb72 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.100167 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a697f90-3278-42b1-8a07-9fa26fe9cb72 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.102113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 249/495] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:35:58.103189 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a697f90-3278-42b1-8a07-9fa26fe9cb72 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:58.113739 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845cdba-316a-4654-9013-f67404f17ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:58.115327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845cdba-316a-4654-9013-f67404f17ec5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-9845cdba-316a-4654-9013-f67404f17ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:58.135768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:58.137623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:58.138522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:58.138522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:58.138522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:58.138522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:58.138522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 247/496] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:35:58.138522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877cdbf-dcdc-4556-baa9-61f9d4c9baa4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.138895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877cdbf-dcdc-4556-baa9-61f9d4c9baa4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.139055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877cdbf-dcdc-4556-baa9-61f9d4c9baa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.159945 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c877cdbf-dcdc-4556-baa9-61f9d4c9baa4 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:58.162456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c877cdbf-dcdc-4556-baa9-61f9d4c9baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:58.240278 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a697f90-3278-42b1-8a07-9fa26fe9cb72 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:58.244231 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:58.281502 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 248/497] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:58.283959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450822-115c-426f-ab75-4371196961ba None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.284524 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450822-115c-426f-ab75-4371196961ba None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.285006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e450822-115c-426f-ab75-4371196961ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.285747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8fe90-508e-4bbd-8638-9afbf7b4b8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:58.287141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8fe90-508e-4bbd-8638-9afbf7b4b8f9 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.287641 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8fe90-508e-4bbd-8638-9afbf7b4b8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.288133 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8fe90-508e-4bbd-8638-9afbf7b4b8f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.307968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8fe90-508e-4bbd-8638-9afbf7b4b8f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:58.309799 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8fe90-508e-4bbd-8638-9afbf7b4b8f9 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:58.317094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-1e450822-115c-426f-ab75-4371196961ba None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:35:58.319119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-1e450822-115c-426f-ab75-4371196961ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-3de8fe90-508e-4bbd-8638-9afbf7b4b8f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:58.329302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:58.331073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:58.333412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:58.333412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:58.333412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:58.333412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:58.333412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 250/498] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:58.333412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8fe90-508e-4bbd-8638-9afbf7b4b8f9 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:58.385331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:58.436074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 249/499] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:35:58.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e450822-115c-426f-ab75-4371196961ba None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:58.450803 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8fe90-508e-4bbd-8638-9afbf7b4b8f9 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:58.514139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c009c-884a-4cd8-ad8f-35418ee4f502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:58.515295 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c009c-884a-4cd8-ad8f-35418ee4f502 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.515664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c009c-884a-4cd8-ad8f-35418ee4f502 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.516046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c009c-884a-4cd8-ad8f-35418ee4f502 None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.521038 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c009c-884a-4cd8-ad8f-35418ee4f502 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:58.521038 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c009c-884a-4cd8-ad8f-35418ee4f502 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:58.521038 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c009c-884a-4cd8-ad8f-35418ee4f502 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:58.536949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 251/500] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:58.537855 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c009c-884a-4cd8-ad8f-35418ee4f502 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:58.562185 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:58.569777 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e450822-115c-426f-ab75-4371196961ba None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:58.610061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3921e6-f965-4b47-8ba9-36c2dbe478d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:58.611133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3921e6-f965-4b47-8ba9-36c2dbe478d6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.611475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3921e6-f965-4b47-8ba9-36c2dbe478d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.611807 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3921e6-f965-4b47-8ba9-36c2dbe478d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.625628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3921e6-f965-4b47-8ba9-36c2dbe478d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-fe3921e6-f965-4b47-8ba9-36c2dbe478d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:58.634591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:58.636426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 250/501] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:58.638756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3921e6-f965-4b47-8ba9-36c2dbe478d6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:58.678693 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c009c-884a-4cd8-ad8f-35418ee4f502 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:58.684028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:58.733315 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fa320-1fca-4bd3-95ce-86c14a76b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:58.734361 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fa320-1fca-4bd3-95ce-86c14a76b1d4 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.734817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fa320-1fca-4bd3-95ce-86c14a76b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.735264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363fa320-1fca-4bd3-95ce-86c14a76b1d4 None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.736514 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fa320-1fca-4bd3-95ce-86c14a76b1d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:58.737013 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fa320-1fca-4bd3-95ce-86c14a76b1d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:58.739372 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363fa320-1fca-4bd3-95ce-86c14a76b1d4 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:58.759170 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 252/502] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:58.760583 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fa320-1fca-4bd3-95ce-86c14a76b1d4 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:58.787164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3921e6-f965-4b47-8ba9-36c2dbe478d6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:58.843531 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac03640-ccd9-4371-80a0-87f3d83e16b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:58.844806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac03640-ccd9-4371-80a0-87f3d83e16b4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.845354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac03640-ccd9-4371-80a0-87f3d83e16b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.845685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac03640-ccd9-4371-80a0-87f3d83e16b4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.863651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac03640-ccd9-4371-80a0-87f3d83e16b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-eac03640-ccd9-4371-80a0-87f3d83e16b4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:35:58.877063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:58.878830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 251/503] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:58.880336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac03640-ccd9-4371-80a0-87f3d83e16b4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:58.883217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:58.914009 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363fa320-1fca-4bd3-95ce-86c14a76b1d4 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:58.957135 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca027528-2822-470d-bfb6-6dba8c0b3f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:58.958103 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca027528-2822-470d-bfb6-6dba8c0b3f67 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:58.958454 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca027528-2822-470d-bfb6-6dba8c0b3f67 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:58.958783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca027528-2822-470d-bfb6-6dba8c0b3f67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:58.969391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca027528-2822-470d-bfb6-6dba8c0b3f67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:58.971531 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca027528-2822-470d-bfb6-6dba8c0b3f67 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-ca027528-2822-470d-bfb6-6dba8c0b3f67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:35:58.989272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:58.990963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:58.993869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:35:58.993869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:35:58.993869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:35:58.993869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:35:58.993869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:35:58.993869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:35:58.993869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:35:58.993869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:58.993869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 253/504] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:58.993869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca027528-2822-470d-bfb6-6dba8c0b3f67 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:59.016553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:59.028334 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac03640-ccd9-4371-80a0-87f3d83e16b4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:59.076511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186f08d-264a-473c-b5f7-41e9dc755707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:59.077367 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186f08d-264a-473c-b5f7-41e9dc755707 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.078155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186f08d-264a-473c-b5f7-41e9dc755707 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.078155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186f08d-264a-473c-b5f7-41e9dc755707 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.079174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186f08d-264a-473c-b5f7-41e9dc755707 None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:59.079580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186f08d-264a-473c-b5f7-41e9dc755707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:59.081216 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3186f08d-264a-473c-b5f7-41e9dc755707 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:59.091943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 252/505] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:35:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:59.093206 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186f08d-264a-473c-b5f7-41e9dc755707 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:59.138191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca027528-2822-470d-bfb6-6dba8c0b3f67 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:59.180587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ef2b3-ef51-4ab7-af1f-5e9bffe6d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:59.181487 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef2b3-ef51-4ab7-af1f-5e9bffe6d039 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.181853 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef2b3-ef51-4ab7-af1f-5e9bffe6d039 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.182195 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ef2b3-ef51-4ab7-af1f-5e9bffe6d039 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.185876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:59.191919 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ef2b3-ef51-4ab7-af1f-5e9bffe6d039 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:59.193951 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ef2b3-ef51-4ab7-af1f-5e9bffe6d039 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-693ef2b3-ef51-4ab7-af1f-5e9bffe6d039 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:35:59.209768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:59.211535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:59.213508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:35:59.213508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:35:59.213508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:35:59.213508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:35:59.213508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:35:59.213508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:35:59.213508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:35:59.213508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:35:59.213508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 254/506] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:35:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:59.213508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ef2b3-ef51-4ab7-af1f-5e9bffe6d039 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:59.234569 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186f08d-264a-473c-b5f7-41e9dc755707 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:59.288548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d5b73-e1ba-4dea-bf1f-86197813e1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:59.289669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5b73-e1ba-4dea-bf1f-86197813e1c7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.289669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5b73-e1ba-4dea-bf1f-86197813e1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.289944 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d5b73-e1ba-4dea-bf1f-86197813e1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.290580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d5b73-e1ba-4dea-bf1f-86197813e1c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:59.290887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d5b73-e1ba-4dea-bf1f-86197813e1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:59.292374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d5b73-e1ba-4dea-bf1f-86197813e1c7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:59.302141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 253/507] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:35:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:59.303039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d5b73-e1ba-4dea-bf1f-86197813e1c7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:59.336824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:59.369722 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ef2b3-ef51-4ab7-af1f-5e9bffe6d039 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:59.412055 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f114b32-60b5-40df-b47a-672516f5f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:59.412968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f114b32-60b5-40df-b47a-672516f5f784 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.413363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f114b32-60b5-40df-b47a-672516f5f784 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.413754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f114b32-60b5-40df-b47a-672516f5f784 None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.414838 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f114b32-60b5-40df-b47a-672516f5f784 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:59.415250 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f114b32-60b5-40df-b47a-672516f5f784 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:59.417379 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f114b32-60b5-40df-b47a-672516f5f784 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:59.440424 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 255/508] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:59.441595 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f114b32-60b5-40df-b47a-672516f5f784 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:59.454148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d5b73-e1ba-4dea-bf1f-86197813e1c7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:59.493747 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55c2d-6af9-4357-be38-18581859fa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:59.494562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55c2d-6af9-4357-be38-18581859fa98 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.494854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55c2d-6af9-4357-be38-18581859fa98 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.495131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55c2d-6af9-4357-be38-18581859fa98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.508022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55c2d-6af9-4357-be38-18581859fa98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:59.510848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55c2d-6af9-4357-be38-18581859fa98 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:59.525149 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-cca55c2d-6af9-4357-be38-18581859fa98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:59.532624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:59.534379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:59.536133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:59.536133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:59.536133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:59.536133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:59.536133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 254/509] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:59.536133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55c2d-6af9-4357-be38-18581859fa98 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:59.596523 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f114b32-60b5-40df-b47a-672516f5f784 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:59.632537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:59.652019 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f3143-a85a-429e-9a0e-06335906d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:59.653089 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3143-a85a-429e-9a0e-06335906d886 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.653536 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3143-a85a-429e-9a0e-06335906d886 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.653974 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941f3143-a85a-429e-9a0e-06335906d886 None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.655114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f3143-a85a-429e-9a0e-06335906d886 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:59.655617 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f3143-a85a-429e-9a0e-06335906d886 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:59.658152 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941f3143-a85a-429e-9a0e-06335906d886 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:59.676571 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 256/510] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:59.678172 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f3143-a85a-429e-9a0e-06335906d886 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:59.686002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55c2d-6af9-4357-be38-18581859fa98 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:59.735277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d953835-f565-4fe1-83c2-10f0442b4983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:59.736289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d953835-f565-4fe1-83c2-10f0442b4983 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.736766 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d953835-f565-4fe1-83c2-10f0442b4983 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.737197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d953835-f565-4fe1-83c2-10f0442b4983 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.754912 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d953835-f565-4fe1-83c2-10f0442b4983 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:59.757062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d953835-f565-4fe1-83c2-10f0442b4983 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-0d953835-f565-4fe1-83c2-10f0442b4983 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:35:59.779648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:35:59.781814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:35:59.783706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:35:59.783706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:35:59.783706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:35:59.783706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:35:59.783706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 255/511] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:35:59.783706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d953835-f565-4fe1-83c2-10f0442b4983 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:59.821886 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941f3143-a85a-429e-9a0e-06335906d886 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:59.844859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:59.868084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de37c81-ed9a-415a-b709-932dd7743b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:59.868932 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de37c81-ed9a-415a-b709-932dd7743b61 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.869349 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de37c81-ed9a-415a-b709-932dd7743b61 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.869717 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de37c81-ed9a-415a-b709-932dd7743b61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.870743 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de37c81-ed9a-415a-b709-932dd7743b61 None admin] RBAC: Adding query filter params (role.id=b3da02096234495595b953977e8296d3, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=070dbe04e894424f99365e998376144e) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:59.871194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de37c81-ed9a-415a-b709-932dd7743b61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:59.872830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de37c81-ed9a-415a-b709-932dd7743b61 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:35:59.879484 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 257/512] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:59 2022] GET /identity/v3/role_assignments?user.id=070dbe04e894424f99365e998376144e&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=b3da02096234495595b953977e8296d3 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:35:59.880033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de37c81-ed9a-415a-b709-932dd7743b61 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:35:59.924401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d953835-f565-4fe1-83c2-10f0442b4983 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:35:59.962880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:35:59.979827 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311585b-8e47-4f25-b9fe-19f3b4e8fa69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:35:59.980746 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311585b-8e47-4f25-b9fe-19f3b4e8fa69 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:35:59.981134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311585b-8e47-4f25-b9fe-19f3b4e8fa69 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:35:59.981513 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311585b-8e47-4f25-b9fe-19f3b4e8fa69 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:35:59.982379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311585b-8e47-4f25-b9fe-19f3b4e8fa69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:35:59.982795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311585b-8e47-4f25-b9fe-19f3b4e8fa69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:35:59.984392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311585b-8e47-4f25-b9fe-19f3b4e8fa69 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.000835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 256/513] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:00.001800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311585b-8e47-4f25-b9fe-19f3b4e8fa69 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.080704 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de37c81-ed9a-415a-b709-932dd7743b61 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.146480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a974a3-c338-46df-8841-4d844d788c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.147639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a974a3-c338-46df-8841-4d844d788c5a None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.148211 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a974a3-c338-46df-8841-4d844d788c5a None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.148726 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a974a3-c338-46df-8841-4d844d788c5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.150210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a974a3-c338-46df-8841-4d844d788c5a None admin] RBAC: Adding query filter params (role.id=b3da02096234495595b953977e8296d3, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=b82d01982ea7412aa396b517ed80bd4c) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:00.150753 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a974a3-c338-46df-8841-4d844d788c5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:00.153558 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a974a3-c338-46df-8841-4d844d788c5a None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.172461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 258/514] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:35:59 2022] GET /identity/v3/role_assignments?user.id=b82d01982ea7412aa396b517ed80bd4c&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=b3da02096234495595b953977e8296d3 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:00.172461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a974a3-c338-46df-8841-4d844d788c5a None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.218971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311585b-8e47-4f25-b9fe-19f3b4e8fa69 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.259769 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:00.307776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b94ec-632c-4fc1-9559-1285ad8ae616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.309061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b94ec-632c-4fc1-9559-1285ad8ae616 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.309718 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b94ec-632c-4fc1-9559-1285ad8ae616 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.310217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b94ec-632c-4fc1-9559-1285ad8ae616 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.312874 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b94ec-632c-4fc1-9559-1285ad8ae616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:00.312874 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b94ec-632c-4fc1-9559-1285ad8ae616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:00.315977 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b94ec-632c-4fc1-9559-1285ad8ae616 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.345793 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 257/515] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:00.350943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b94ec-632c-4fc1-9559-1285ad8ae616 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.392870 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a974a3-c338-46df-8841-4d844d788c5a None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.419947 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:00.476583 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf39e10-c362-4daf-aa69-fde8f7ed43fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.478411 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf39e10-c362-4daf-aa69-fde8f7ed43fd None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.479124 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf39e10-c362-4daf-aa69-fde8f7ed43fd None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.479802 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf39e10-c362-4daf-aa69-fde8f7ed43fd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.495583 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf39e10-c362-4daf-aa69-fde8f7ed43fd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:00.498801 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf39e10-c362-4daf-aa69-fde8f7ed43fd None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.499121 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b94ec-632c-4fc1-9559-1285ad8ae616 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-7cf39e10-c362-4daf-aa69-fde8f7ed43fd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:00.530144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:00.532140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:00.534192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:00.534192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:00.534192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:00.534192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:00.534192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:00.534192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:00.534192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:00.534192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:00.534192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:00.534192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:00.538203 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 259/516] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:00.546768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf39e10-c362-4daf-aa69-fde8f7ed43fd None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.549926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375904-832e-457c-a73e-d376359ecaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.550774 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375904-832e-457c-a73e-d376359ecaa5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.551060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375904-832e-457c-a73e-d376359ecaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.551341 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8375904-832e-457c-a73e-d376359ecaa5 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.562073 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8375904-832e-457c-a73e-d376359ecaa5 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:00.563604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8375904-832e-457c-a73e-d376359ecaa5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-a8375904-832e-457c-a73e-d376359ecaa5 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:00.585142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:00.587344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:00.589494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:00.589494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:00.589494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:00.589494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:00.589494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:00.589494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:00.589494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:00.589494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:00.589494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:00.589494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:00.593725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 258/517] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:00.605880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375904-832e-457c-a73e-d376359ecaa5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.722420 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf39e10-c362-4daf-aa69-fde8f7ed43fd None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.725124 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:00.764252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80d033-cdc6-4798-b73b-b2d9bdafd81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.765638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d033-cdc6-4798-b73b-b2d9bdafd81b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.766071 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d033-cdc6-4798-b73b-b2d9bdafd81b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.766514 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d033-cdc6-4798-b73b-b2d9bdafd81b None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.767650 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80d033-cdc6-4798-b73b-b2d9bdafd81b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:00.768170 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80d033-cdc6-4798-b73b-b2d9bdafd81b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:00.770209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80d033-cdc6-4798-b73b-b2d9bdafd81b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.793689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8375904-832e-457c-a73e-d376359ecaa5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:00.795985 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 260/518] 10.222.0.24 () {56 vars in 1137 bytes} [Sat Jun 4 20:36:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:00.806428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80d033-cdc6-4798-b73b-b2d9bdafd81b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.824740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:00.872732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840bd60-5b9f-4a0e-acd1-e994cc58fef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:00.874569 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840bd60-5b9f-4a0e-acd1-e994cc58fef4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:00.875506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840bd60-5b9f-4a0e-acd1-e994cc58fef4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:00.876304 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840bd60-5b9f-4a0e-acd1-e994cc58fef4 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:00.878456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840bd60-5b9f-4a0e-acd1-e994cc58fef4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:00.879451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840bd60-5b9f-4a0e-acd1-e994cc58fef4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:00.882544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840bd60-5b9f-4a0e-acd1-e994cc58fef4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:00.910922 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 259/519] 10.222.0.24 () {56 vars in 1139 bytes} [Sat Jun 4 20:36:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:00.917381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840bd60-5b9f-4a0e-acd1-e994cc58fef4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:00.993407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80d033-cdc6-4798-b73b-b2d9bdafd81b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:01.074328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840bd60-5b9f-4a0e-acd1-e994cc58fef4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:01.081304 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e62b39-4807-4f02-985a-035e819c0865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:01.082797 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e62b39-4807-4f02-985a-035e819c0865 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:01.084421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e62b39-4807-4f02-985a-035e819c0865 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:01.085287 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e62b39-4807-4f02-985a-035e819c0865 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:01.125222 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:01.136161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465480bc-0a57-42b8-b840-c39281f09727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:01.136927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465480bc-0a57-42b8-b840-c39281f09727 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:01.137217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465480bc-0a57-42b8-b840-c39281f09727 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:01.137498 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465480bc-0a57-42b8-b840-c39281f09727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:01.176037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:01.215250 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e62b39-4807-4f02-985a-035e819c0865 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:01.219772 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e62b39-4807-4f02-985a-035e819c0865 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:01.234322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465480bc-0a57-42b8-b840-c39281f09727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:01.237502 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465480bc-0a57-42b8-b840-c39281f09727 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:01.348551 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 261/520] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:01.356725 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e62b39-4807-4f02-985a-035e819c0865 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:01.429481 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:01.454191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 260/521] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:36:01.459752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465480bc-0a57-42b8-b840-c39281f09727 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:01.484124 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e62b39-4807-4f02-985a-035e819c0865 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:01.524052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527019c7-374e-43ea-9f80-2e059276ab82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:01.526195 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527019c7-374e-43ea-9f80-2e059276ab82 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:01.526482 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527019c7-374e-43ea-9f80-2e059276ab82 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:01.526781 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527019c7-374e-43ea-9f80-2e059276ab82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:01.539495 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527019c7-374e-43ea-9f80-2e059276ab82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:01.541038 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527019c7-374e-43ea-9f80-2e059276ab82 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-527019c7-374e-43ea-9f80-2e059276ab82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:01.561066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:01.562776 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:01.564465 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:01.564465 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:01.564465 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:01.564465 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:01.564465 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 262/522] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:01.573083 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527019c7-374e-43ea-9f80-2e059276ab82 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:01.588359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:01.645982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465480bc-0a57-42b8-b840-c39281f09727 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:01.717160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04c128-c85d-4d2c-aab9-d0a52572d503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:01.720046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04c128-c85d-4d2c-aab9-d0a52572d503 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:01.720715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04c128-c85d-4d2c-aab9-d0a52572d503 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:01.722136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04c128-c85d-4d2c-aab9-d0a52572d503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:01.751207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527019c7-374e-43ea-9f80-2e059276ab82 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:01.751825 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04c128-c85d-4d2c-aab9-d0a52572d503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:01.756717 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04c128-c85d-4d2c-aab9-d0a52572d503 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:01.771031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:01.798175 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31633f1-6bc8-446c-9e72-cd0bcbbcfb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:01.798865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31633f1-6bc8-446c-9e72-cd0bcbbcfb2c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:01.799146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31633f1-6bc8-446c-9e72-cd0bcbbcfb2c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:01.799428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31633f1-6bc8-446c-9e72-cd0bcbbcfb2c None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:01.800466 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31633f1-6bc8-446c-9e72-cd0bcbbcfb2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:01.800768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31633f1-6bc8-446c-9e72-cd0bcbbcfb2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:01.802181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31633f1-6bc8-446c-9e72-cd0bcbbcfb2c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-8a04c128-c85d-4d2c-aab9-d0a52572d503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:01.807886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:01.810020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:01.811669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:01.811669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:01.811669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:01.811669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:01.821423 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 261/523] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:01.825286 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 263/524] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:01.826387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04c128-c85d-4d2c-aab9-d0a52572d503 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:01.839241 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31633f1-6bc8-446c-9e72-cd0bcbbcfb2c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:01.964663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04c128-c85d-4d2c-aab9-d0a52572d503 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:02.003412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:02.048413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dbe77-b1a8-46bc-b097-affcf81d8949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:02.050091 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dbe77-b1a8-46bc-b097-affcf81d8949 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.051264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dbe77-b1a8-46bc-b097-affcf81d8949 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.051740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dbe77-b1a8-46bc-b097-affcf81d8949 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.053250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4dbe77-b1a8-46bc-b097-affcf81d8949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:02.053790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4dbe77-b1a8-46bc-b097-affcf81d8949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:02.055276 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31633f1-6bc8-446c-9e72-cd0bcbbcfb2c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:02.056272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4dbe77-b1a8-46bc-b097-affcf81d8949 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:02.075383 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 262/525] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:02.083736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dbe77-b1a8-46bc-b097-affcf81d8949 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:02.130595 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080cc1f-e113-45fa-9004-df2650a44813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:02.135255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080cc1f-e113-45fa-9004-df2650a44813 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.135914 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080cc1f-e113-45fa-9004-df2650a44813 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.136406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080cc1f-e113-45fa-9004-df2650a44813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.151534 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080cc1f-e113-45fa-9004-df2650a44813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:02.154485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080cc1f-e113-45fa-9004-df2650a44813 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-4080cc1f-e113-45fa-9004-df2650a44813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:02.188161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:02.189188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:02.190046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:02.190046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:02.190046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:02.190046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:02.190046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:02.190046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:02.190046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:02.190046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:02.196463 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 264/526] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:02.202171 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080cc1f-e113-45fa-9004-df2650a44813 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:02.271263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:02.308896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dbe77-b1a8-46bc-b097-affcf81d8949 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:02.384787 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05408704-aa5c-433c-8f50-a03bebddaa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:02.386779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05408704-aa5c-433c-8f50-a03bebddaa80 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.388161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05408704-aa5c-433c-8f50-a03bebddaa80 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.388161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05408704-aa5c-433c-8f50-a03bebddaa80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.403167 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05408704-aa5c-433c-8f50-a03bebddaa80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:02.406377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05408704-aa5c-433c-8f50-a03bebddaa80 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:02.414496 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080cc1f-e113-45fa-9004-df2650a44813 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-05408704-aa5c-433c-8f50-a03bebddaa80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:02.439196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:02.441105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:02.442846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:02.442846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:02.442846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:02.442846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:02.442846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:02.442846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:02.442846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:02.442846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:02.448796 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 263/527] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:02.454232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05408704-aa5c-433c-8f50-a03bebddaa80 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:02.491773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f371876-25fb-48e0-97f2-7ea5704f69f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:02.493026 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f371876-25fb-48e0-97f2-7ea5704f69f1 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.493526 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f371876-25fb-48e0-97f2-7ea5704f69f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.494028 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f371876-25fb-48e0-97f2-7ea5704f69f1 None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.495597 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f371876-25fb-48e0-97f2-7ea5704f69f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:02.496156 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f371876-25fb-48e0-97f2-7ea5704f69f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:02.498946 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f371876-25fb-48e0-97f2-7ea5704f69f1 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:02.526140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:02.527072 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 265/528] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:02.529791 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b47937-25fe-4687-a9a3-a3bbc79c7eeb None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.530292 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b47937-25fe-4687-a9a3-a3bbc79c7eeb None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.530777 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b47937-25fe-4687-a9a3-a3bbc79c7eeb None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.533691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 266/529] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:02.540578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b47937-25fe-4687-a9a3-a3bbc79c7eeb None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:02.641800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05408704-aa5c-433c-8f50-a03bebddaa80 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:02.699183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:02.702827 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e4b66-c6ac-4a1e-acfc-5fdb4eb96213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:02.703967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4b66-c6ac-4a1e-acfc-5fdb4eb96213 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.704410 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4b66-c6ac-4a1e-acfc-5fdb4eb96213 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.704948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e4b66-c6ac-4a1e-acfc-5fdb4eb96213 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.706392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e4b66-c6ac-4a1e-acfc-5fdb4eb96213 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:02.706951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e4b66-c6ac-4a1e-acfc-5fdb4eb96213 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:02.709262 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374e4b66-c6ac-4a1e-acfc-5fdb4eb96213 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:02.713372 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b47937-25fe-4687-a9a3-a3bbc79c7eeb None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:02.739398 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 264/530] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:02.742961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38434d96-d661-4446-93ea-9826eac56dc4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.743544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38434d96-d661-4446-93ea-9826eac56dc4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.744114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38434d96-d661-4446-93ea-9826eac56dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.768702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-38434d96-d661-4446-93ea-9826eac56dc4 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:02.770520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-38434d96-d661-4446-93ea-9826eac56dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:02.778500 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae513f1-dd3c-44eb-a843-edc485372f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:02.779516 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae513f1-dd3c-44eb-a843-edc485372f49 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:02.780019 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae513f1-dd3c-44eb-a843-edc485372f49 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:02.780570 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae513f1-dd3c-44eb-a843-edc485372f49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:02.783228 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae513f1-dd3c-44eb-a843-edc485372f49 None admin] RBAC: Adding query filter params (role.id=b3da02096234495595b953977e8296d3, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=eea7c50b99044720801876cce86e4311) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:02.783799 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae513f1-dd3c-44eb-a843-edc485372f49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:02.787602 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae513f1-dd3c-44eb-a843-edc485372f49 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:02.804489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 267/531] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:02 2022] GET /identity/v3/role_assignments?user.id=eea7c50b99044720801876cce86e4311&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=b3da02096234495595b953977e8296d3 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:02.804489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae513f1-dd3c-44eb-a843-edc485372f49 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:02.905131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 265/532] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:02.947218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38434d96-d661-4446-93ea-9826eac56dc4 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:03.022647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:03.057861 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae513f1-dd3c-44eb-a843-edc485372f49 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:03.136420 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c6f16-1237-431b-ae5a-4f7dbc1a72e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:03.137751 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6f16-1237-431b-ae5a-4f7dbc1a72e1 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.138250 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6f16-1237-431b-ae5a-4f7dbc1a72e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.138757 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c6f16-1237-431b-ae5a-4f7dbc1a72e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.141674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c6f16-1237-431b-ae5a-4f7dbc1a72e1 None admin] RBAC: Adding query filter params (role.id=b3da02096234495595b953977e8296d3, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=75a7632fe5b5474ab6afd5b3d1bee4e6) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:03.141674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c6f16-1237-431b-ae5a-4f7dbc1a72e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:03.144143 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c6f16-1237-431b-ae5a-4f7dbc1a72e1 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:03.156501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 268/533] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:02 2022] GET /identity/v3/role_assignments?user.id=75a7632fe5b5474ab6afd5b3d1bee4e6&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=b3da02096234495595b953977e8296d3 => generated 259 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:03.163459 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38434d96-d661-4446-93ea-9826eac56dc4 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:03.241915 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdd775-9157-4051-b14b-121d7235444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:03.243840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdd775-9157-4051-b14b-121d7235444e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.244661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdd775-9157-4051-b14b-121d7235444e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.245417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bdd775-9157-4051-b14b-121d7235444e None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.269577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bdd775-9157-4051-b14b-121d7235444e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-88bdd775-9157-4051-b14b-121d7235444e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:03.286355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:03.288161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:03.289867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:03.296573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 266/534] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:03.298019 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820b930-176f-4568-94d1-b742015706ab None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.298988 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820b930-176f-4568-94d1-b742015706ab None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.299907 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820b930-176f-4568-94d1-b742015706ab None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.302800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdd775-9157-4051-b14b-121d7235444e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:03.303934 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 269/535] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:03.314364 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f5b89-6c62-41ca-a97a-c0d597f4ba73 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.315305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f5b89-6c62-41ca-a97a-c0d597f4ba73 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.316084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f5b89-6c62-41ca-a97a-c0d597f4ba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.347615 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-e84f5b89-6c62-41ca-a97a-c0d597f4ba73 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:03.351739 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-e84f5b89-6c62-41ca-a97a-c0d597f4ba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:03.401033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:03.476253 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:03.512476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bdd775-9157-4051-b14b-121d7235444e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:03.518064 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 270/536] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:03.566194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f5b89-6c62-41ca-a97a-c0d597f4ba73 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:03.575646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acce4f-438b-456d-9dcd-13691c62faa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:03.576745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acce4f-438b-456d-9dcd-13691c62faa7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.577185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acce4f-438b-456d-9dcd-13691c62faa7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.577629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acce4f-438b-456d-9dcd-13691c62faa7 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.578896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acce4f-438b-456d-9dcd-13691c62faa7 None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:03.579390 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acce4f-438b-456d-9dcd-13691c62faa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:03.581790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acce4f-438b-456d-9dcd-13691c62faa7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:03.598655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 267/537] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:03.604840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acce4f-438b-456d-9dcd-13691c62faa7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:03.739141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f5b89-6c62-41ca-a97a-c0d597f4ba73 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:03.784331 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8a560-10bc-4dbd-b6b4-830789623edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:03.785362 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a560-10bc-4dbd-b6b4-830789623edb None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.785699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a560-10bc-4dbd-b6b4-830789623edb None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.786056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8a560-10bc-4dbd-b6b4-830789623edb None admin] PATH_INFO: `/v3/roles/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.798066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acce4f-438b-456d-9dcd-13691c62faa7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:03.798708 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8a560-10bc-4dbd-b6b4-830789623edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-4fb8a560-10bc-4dbd-b6b4-830789623edb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:03.807381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:03.808903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:03.810409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 271/538] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:03.822829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8a560-10bc-4dbd-b6b4-830789623edb None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:03.853371 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:03.869932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4ae8f-d48e-46a6-abea-e09e42ca331c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:03.871539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4ae8f-d48e-46a6-abea-e09e42ca331c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:03.872070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4ae8f-d48e-46a6-abea-e09e42ca331c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:03.873302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4ae8f-d48e-46a6-abea-e09e42ca331c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:03.900483 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4ae8f-d48e-46a6-abea-e09e42ca331c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:03.900483 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4ae8f-d48e-46a6-abea-e09e42ca331c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:03.905728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-3dc4ae8f-d48e-46a6-abea-e09e42ca331c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:03.939755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:03.941480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:03.943062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:03.943062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:03.943062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:03.943062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:03.943472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 268/539] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:03.949310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4ae8f-d48e-46a6-abea-e09e42ca331c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:03.988541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8a560-10bc-4dbd-b6b4-830789623edb None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.036321 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb77f2-4da8-43ea-a651-d31fc9eb7b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.037995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb77f2-4da8-43ea-a651-d31fc9eb7b4b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.038733 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb77f2-4da8-43ea-a651-d31fc9eb7b4b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.038733 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb77f2-4da8-43ea-a651-d31fc9eb7b4b None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.044480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb77f2-4da8-43ea-a651-d31fc9eb7b4b None admin] RBAC: Adding query filter params (name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:04.044480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb77f2-4da8-43ea-a651-d31fc9eb7b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.044480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb77f2-4da8-43ea-a651-d31fc9eb7b4b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.054280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 272/540] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:04.065616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb77f2-4da8-43ea-a651-d31fc9eb7b4b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.090201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4ae8f-d48e-46a6-abea-e09e42ca331c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.131446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edd1aa-29c8-4e9c-a5c8-98f3b1410b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.132590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edd1aa-29c8-4e9c-a5c8-98f3b1410b85 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.132912 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edd1aa-29c8-4e9c-a5c8-98f3b1410b85 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.133744 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39edd1aa-29c8-4e9c-a5c8-98f3b1410b85 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.134606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edd1aa-29c8-4e9c-a5c8-98f3b1410b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:04.134926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edd1aa-29c8-4e9c-a5c8-98f3b1410b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.136363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39edd1aa-29c8-4e9c-a5c8-98f3b1410b85 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.155904 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 269/541] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:04.156960 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edd1aa-29c8-4e9c-a5c8-98f3b1410b85 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.167466 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:04.197609 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb77f2-4da8-43ea-a651-d31fc9eb7b4b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.236274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dfe89-b20c-4fcf-bf53-38d762763fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.237512 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dfe89-b20c-4fcf-bf53-38d762763fb7 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.238102 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dfe89-b20c-4fcf-bf53-38d762763fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.238568 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dfe89-b20c-4fcf-bf53-38d762763fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.240798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:04.251490 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dfe89-b20c-4fcf-bf53-38d762763fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.253327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0dfe89-b20c-4fcf-bf53-38d762763fb7 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.269396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39edd1aa-29c8-4e9c-a5c8-98f3b1410b85 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-1d0dfe89-b20c-4fcf-bf53-38d762763fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:04.273548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:04.274485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:04.275322 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:04.275322 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:04.275322 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:04.275322 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:04.282576 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 273/542] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:04.284067 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dfe89-b20c-4fcf-bf53-38d762763fb7 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.315298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b10454-669e-44af-9c5b-80e82054f107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.316185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10454-669e-44af-9c5b-80e82054f107 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.316509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10454-669e-44af-9c5b-80e82054f107 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.316840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b10454-669e-44af-9c5b-80e82054f107 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.326462 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b10454-669e-44af-9c5b-80e82054f107 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.327254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b10454-669e-44af-9c5b-80e82054f107 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-86b10454-669e-44af-9c5b-80e82054f107 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:04.343974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:04.344930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:04.345790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:04.345790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:04.345790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:04.345790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:04.345790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:04.345790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:04.345790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:04.345790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:04.345790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:36:04.345790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:04.350301 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 270/543] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:04.351425 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b10454-669e-44af-9c5b-80e82054f107 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.404470 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dfe89-b20c-4fcf-bf53-38d762763fb7 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.436945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:04.451679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f9f94-4513-4ff3-b16a-a50edbd11c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.452951 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9f94-4513-4ff3-b16a-a50edbd11c3f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.453474 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9f94-4513-4ff3-b16a-a50edbd11c3f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.453975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f9f94-4513-4ff3-b16a-a50edbd11c3f None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.454977 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f9f94-4513-4ff3-b16a-a50edbd11c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:04.455544 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f9f94-4513-4ff3-b16a-a50edbd11c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.457270 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f9f94-4513-4ff3-b16a-a50edbd11c3f None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.478193 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 274/544] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:04.479540 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f9f94-4513-4ff3-b16a-a50edbd11c3f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.480276 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b10454-669e-44af-9c5b-80e82054f107 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.501975 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:04.536315 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d776-6d65-46ec-b35a-f6da0f90e29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.536856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d776-6d65-46ec-b35a-f6da0f90e29a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.537190 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d776-6d65-46ec-b35a-f6da0f90e29a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.537473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565d776-6d65-46ec-b35a-f6da0f90e29a None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.538430 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565d776-6d65-46ec-b35a-f6da0f90e29a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:04.538750 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565d776-6d65-46ec-b35a-f6da0f90e29a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.540421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565d776-6d65-46ec-b35a-f6da0f90e29a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.568681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 271/545] 10.222.0.24 () {56 vars in 1137 bytes} [Sat Jun 4 20:36:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:04.570323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d776-6d65-46ec-b35a-f6da0f90e29a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.622189 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f9f94-4513-4ff3-b16a-a50edbd11c3f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.665536 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144640f4-c35d-4c4d-bbb9-aad9a81b29d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.666799 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144640f4-c35d-4c4d-bbb9-aad9a81b29d9 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.667342 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144640f4-c35d-4c4d-bbb9-aad9a81b29d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.667827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144640f4-c35d-4c4d-bbb9-aad9a81b29d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.677428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144640f4-c35d-4c4d-bbb9-aad9a81b29d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.679554 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144640f4-c35d-4c4d-bbb9-aad9a81b29d9 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.696053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565d776-6d65-46ec-b35a-f6da0f90e29a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-144640f4-c35d-4c4d-bbb9-aad9a81b29d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:04.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:04.705040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:04.705896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:04.705896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:04.705896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:04.705896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:04.705896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:04.705896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:04.705896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:04.705896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:04.705896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:04.705896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:04.714101 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 275/546] 10.222.0.24 () {56 vars in 1093 bytes} [Sat Jun 4 20:36:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:04.715489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144640f4-c35d-4c4d-bbb9-aad9a81b29d9 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.740063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7679e-404e-4ccb-a1cb-8b318332ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.740965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7679e-404e-4ccb-a1cb-8b318332ff5e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.741257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7679e-404e-4ccb-a1cb-8b318332ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.741660 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a7679e-404e-4ccb-a1cb-8b318332ff5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.753785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7679e-404e-4ccb-a1cb-8b318332ff5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.755312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a7679e-404e-4ccb-a1cb-8b318332ff5e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-78a7679e-404e-4ccb-a1cb-8b318332ff5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:04.776023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:04.777604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:04.778841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:04.778841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:04.778841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:04.778841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:04.778841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 272/547] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:04.783321 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7679e-404e-4ccb-a1cb-8b318332ff5e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.786837 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:04.816749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:04.857667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144640f4-c35d-4c4d-bbb9-aad9a81b29d9 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:04.898231 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813c9f9-5ceb-462e-b446-a91b72814b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:04.899740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c9f9-5ceb-462e-b446-a91b72814b83 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:04.900312 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c9f9-5ceb-462e-b446-a91b72814b83 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:04.900820 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0813c9f9-5ceb-462e-b446-a91b72814b83 None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:04.901891 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813c9f9-5ceb-462e-b446-a91b72814b83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:04.902403 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813c9f9-5ceb-462e-b446-a91b72814b83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:04.904090 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0813c9f9-5ceb-462e-b446-a91b72814b83 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:04.924603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 276/548] 10.222.0.24 () {56 vars in 1133 bytes} [Sat Jun 4 20:36:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:04.930545 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813c9f9-5ceb-462e-b446-a91b72814b83 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:04.951705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a7679e-404e-4ccb-a1cb-8b318332ff5e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:05.011827 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d154a-56a6-4de8-8a0c-51f0bedab35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:05.012545 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d154a-56a6-4de8-8a0c-51f0bedab35b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:05.012834 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d154a-56a6-4de8-8a0c-51f0bedab35b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:05.013114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d154a-56a6-4de8-8a0c-51f0bedab35b None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:05.013858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d154a-56a6-4de8-8a0c-51f0bedab35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:05.014169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d154a-56a6-4de8-8a0c-51f0bedab35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:05.015945 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d154a-56a6-4de8-8a0c-51f0bedab35b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:05.036975 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 273/549] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:05.038041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d154a-56a6-4de8-8a0c-51f0bedab35b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:05.047698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0813c9f9-5ceb-462e-b446-a91b72814b83 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:05.050890 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:05.086531 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df92e8-4d5a-4e74-86e2-86bcf21d632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:05.087493 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df92e8-4d5a-4e74-86e2-86bcf21d632b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:05.087865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df92e8-4d5a-4e74-86e2-86bcf21d632b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:05.088242 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df92e8-4d5a-4e74-86e2-86bcf21d632b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:05.099911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df92e8-4d5a-4e74-86e2-86bcf21d632b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:05.101379 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df92e8-4d5a-4e74-86e2-86bcf21d632b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-e9df92e8-4d5a-4e74-86e2-86bcf21d632b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:05.120319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:05.121460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:05.122428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:05.122428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:05.122428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:05.122428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:05.127837 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 277/550] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:05.129361 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df92e8-4d5a-4e74-86e2-86bcf21d632b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:05.147673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:05.166808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d154a-56a6-4de8-8a0c-51f0bedab35b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:05.206367 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141d484-2770-4023-a87d-5b3ba2fb7e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:05.207577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d484-2770-4023-a87d-5b3ba2fb7e18 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:05.208064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d484-2770-4023-a87d-5b3ba2fb7e18 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:05.208590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141d484-2770-4023-a87d-5b3ba2fb7e18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:05.218037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141d484-2770-4023-a87d-5b3ba2fb7e18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:05.219981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b141d484-2770-4023-a87d-5b3ba2fb7e18 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-b141d484-2770-4023-a87d-5b3ba2fb7e18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:05.237083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:05.238198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:05.239049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:05.239049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:05.239049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:05.239049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:05.239049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:05.239049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:05.239049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:05.239049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:05.246421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df92e8-4d5a-4e74-86e2-86bcf21d632b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:05.246821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 274/551] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:05.248402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141d484-2770-4023-a87d-5b3ba2fb7e18 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:05.283750 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71243a-303e-4177-afbf-94cdb97f364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:05.284621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71243a-303e-4177-afbf-94cdb97f364e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:05.285147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71243a-303e-4177-afbf-94cdb97f364e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:05.285490 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71243a-303e-4177-afbf-94cdb97f364e None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:05.286670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71243a-303e-4177-afbf-94cdb97f364e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:05.287052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71243a-303e-4177-afbf-94cdb97f364e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:05.289210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71243a-303e-4177-afbf-94cdb97f364e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:05.308528 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 278/552] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:05.311452 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71243a-303e-4177-afbf-94cdb97f364e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:05.335542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:05.372770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141d484-2770-4023-a87d-5b3ba2fb7e18 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:05.418025 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7db652-177f-40a2-9447-8b033ff2838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:05.418720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7db652-177f-40a2-9447-8b033ff2838f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:05.419070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7db652-177f-40a2-9447-8b033ff2838f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:05.419410 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7db652-177f-40a2-9447-8b033ff2838f None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:05.420290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7db652-177f-40a2-9447-8b033ff2838f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:05.421402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7db652-177f-40a2-9447-8b033ff2838f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:05.422975 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7db652-177f-40a2-9447-8b033ff2838f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:05.445496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 275/553] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:05.446969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7db652-177f-40a2-9447-8b033ff2838f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:05.455531 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71243a-303e-4177-afbf-94cdb97f364e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:05.458368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:05.501374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d5e2c-496c-4bb7-9d76-7faa5067063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:05.502229 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d5e2c-496c-4bb7-9d76-7faa5067063f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:05.502509 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d5e2c-496c-4bb7-9d76-7faa5067063f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:05.502782 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221d5e2c-496c-4bb7-9d76-7faa5067063f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:05.520952 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d5e2c-496c-4bb7-9d76-7faa5067063f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:05.527069 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221d5e2c-496c-4bb7-9d76-7faa5067063f None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-221d5e2c-496c-4bb7-9d76-7faa5067063f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:05.547297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:05.548263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:05.549288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:05.549288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:05.549288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:05.549288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:05.549288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:05.549288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:05.549288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:05.549288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:05.557198 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 279/554] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:05.559598 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d5e2c-496c-4bb7-9d76-7faa5067063f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:05.590100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7db652-177f-40a2-9447-8b033ff2838f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:05.638521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347c59b-68f9-449d-a3e2-959e98992ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:05.639465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347c59b-68f9-449d-a3e2-959e98992ca6 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:05.640093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347c59b-68f9-449d-a3e2-959e98992ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:05.640375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2347c59b-68f9-449d-a3e2-959e98992ca6 None admin] PATH_INFO: `/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/070dbe04e894424f99365e998376144e/roles/b3da02096234495595b953977e8296d3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:05.669181 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347c59b-68f9-449d-a3e2-959e98992ca6 None admin] RBAC: Authorizing `identity:create_grant(project_id=793a7b858d3848b3b0df4e9c31d20d2a, user_id=070dbe04e894424f99365e998376144e, role_id=b3da02096234495595b953977e8296d3)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:05.672589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2347c59b-68f9-449d-a3e2-959e98992ca6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:05.702572 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:05.706537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 276/555] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:36:05 2022] PUT /identity/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/070dbe04e894424f99365e998376144e/roles/b3da02096234495595b953977e8296d3 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:36:05.748500 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221d5e2c-496c-4bb7-9d76-7faa5067063f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:05.798280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6b4a1-142c-4d8e-bfdd-9edbe9b774cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:05.799153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b4a1-142c-4d8e-bfdd-9edbe9b774cf None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:05.799442 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b4a1-142c-4d8e-bfdd-9edbe9b774cf None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:05.799724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b4a1-142c-4d8e-bfdd-9edbe9b774cf None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:05.800689 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6b4a1-142c-4d8e-bfdd-9edbe9b774cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:05.801049 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6b4a1-142c-4d8e-bfdd-9edbe9b774cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:05.802608 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6b4a1-142c-4d8e-bfdd-9edbe9b774cf None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:05.818159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 280/556] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:05.827770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347c59b-68f9-449d-a3e2-959e98992ca6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:05.958773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:06.013018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3d0c6-fb7d-48f2-b9e0-89df5997b229 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:06.013686 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3d0c6-fb7d-48f2-b9e0-89df5997b229 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:06.014208 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff3d0c6-fb7d-48f2-b9e0-89df5997b229 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:06.016700 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 281/557] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:06.023150 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d30b-e8ff-4a51-b9d5-6d2c5aa9e10b None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:06.023777 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d30b-e8ff-4a51-b9d5-6d2c5aa9e10b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:06.024254 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d30b-e8ff-4a51-b9d5-6d2c5aa9e10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:06.053727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2347c59b-68f9-449d-a3e2-959e98992ca6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:06.054305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-bcd6d30b-e8ff-4a51-b9d5-6d2c5aa9e10b None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:06.056024 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-bcd6d30b-e8ff-4a51-b9d5-6d2c5aa9e10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:06.123330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e72bea-1f33-4aa7-bcd7-caba60e67572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:06.125267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72bea-1f33-4aa7-bcd7-caba60e67572 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:06.126023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72bea-1f33-4aa7-bcd7-caba60e67572 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:06.126645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e72bea-1f33-4aa7-bcd7-caba60e67572 None admin] PATH_INFO: `/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/b82d01982ea7412aa396b517ed80bd4c/roles/b3da02096234495595b953977e8296d3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:06.139267 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 282/558] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:06.158145 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e72bea-1f33-4aa7-bcd7-caba60e67572 None admin] RBAC: Authorizing `identity:create_grant(project_id=793a7b858d3848b3b0df4e9c31d20d2a, user_id=b82d01982ea7412aa396b517ed80bd4c, role_id=b3da02096234495595b953977e8296d3)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:06.160913 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e72bea-1f33-4aa7-bcd7-caba60e67572 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:06.164860 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6d30b-e8ff-4a51-b9d5-6d2c5aa9e10b None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:06.189637 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 277/559] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:36:05 2022] PUT /identity/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/b82d01982ea7412aa396b517ed80bd4c/roles/b3da02096234495595b953977e8296d3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:36:06.256850 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:06.313904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6d30b-e8ff-4a51-b9d5-6d2c5aa9e10b None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:06.370140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa668f-f3b5-419e-8f11-b20d7a6e80eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:06.370984 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa668f-f3b5-419e-8f11-b20d7a6e80eb None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:06.371280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa668f-f3b5-419e-8f11-b20d7a6e80eb None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:06.371546 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa668f-f3b5-419e-8f11-b20d7a6e80eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:06.384571 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa668f-f3b5-419e-8f11-b20d7a6e80eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-70aa668f-f3b5-419e-8f11-b20d7a6e80eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:06.393091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:06.394879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:06.396593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 283/560] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:06.401680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e72bea-1f33-4aa7-bcd7-caba60e67572 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:06.580489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e72bea-1f33-4aa7-bcd7-caba60e67572 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:06.590012 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:06.622479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e4f25-6065-4833-8e5e-72efea85ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:06.623289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e4f25-6065-4833-8e5e-72efea85ad2d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:06.623715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e4f25-6065-4833-8e5e-72efea85ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:06.624135 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e4f25-6065-4833-8e5e-72efea85ad2d None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:06.625405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e4f25-6065-4833-8e5e-72efea85ad2d None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:06.625958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e4f25-6065-4833-8e5e-72efea85ad2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:06.628272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46e4f25-6065-4833-8e5e-72efea85ad2d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:06.642910 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 278/561] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:06.645696 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cda51-d8a6-4335-a2d1-0716580c7473 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:06.646231 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cda51-d8a6-4335-a2d1-0716580c7473 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:06.646730 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cda51-d8a6-4335-a2d1-0716580c7473 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:06.651483 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e4f25-6065-4833-8e5e-72efea85ad2d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:06.656635 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 284/562] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:06.659912 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a626f3-0576-4727-8308-e73dea006044 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:06.660418 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a626f3-0576-4727-8308-e73dea006044 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:06.660955 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a626f3-0576-4727-8308-e73dea006044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:06.691326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-97a626f3-0576-4727-8308-e73dea006044 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:06.693420 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-97a626f3-0576-4727-8308-e73dea006044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:06.804387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46e4f25-6065-4833-8e5e-72efea85ad2d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:06.814538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 285/563] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:06.840200 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a626f3-0576-4727-8308-e73dea006044 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:06.863092 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0b1a1-8a75-44d4-9546-1c10c2e5ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:06.864641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0b1a1-8a75-44d4-9546-1c10c2e5ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:06.865139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0b1a1-8a75-44d4-9546-1c10c2e5ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:06.865616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0b1a1-8a75-44d4-9546-1c10c2e5ccf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:06.879810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0b1a1-8a75-44d4-9546-1c10c2e5ccf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:06.882319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa0b1a1-8a75-44d4-9546-1c10c2e5ccf5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-faa0b1a1-8a75-44d4-9546-1c10c2e5ccf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:06.904926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:06.905891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:06.906873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:06.906873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:06.906873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:06.906873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:06.910036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 279/564] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:06.920691 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0b1a1-8a75-44d4-9546-1c10c2e5ccf5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:06.941392 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:06.968770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:07.004630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a626f3-0576-4727-8308-e73dea006044 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:07.051780 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cbc3c-ab1d-48a4-ace4-edf20422e292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:07.052823 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cbc3c-ab1d-48a4-ace4-edf20422e292 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:07.053205 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cbc3c-ab1d-48a4-ace4-edf20422e292 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:07.053579 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762cbc3c-ab1d-48a4-ace4-edf20422e292 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:07.074051 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762cbc3c-ab1d-48a4-ace4-edf20422e292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-762cbc3c-ab1d-48a4-ace4-edf20422e292 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:07.084109 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:07.085280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:07.086110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:07.087613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 286/565] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:07.092994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cbc3c-ab1d-48a4-ace4-edf20422e292 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:07.131751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa0b1a1-8a75-44d4-9546-1c10c2e5ccf5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:07.201550 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db665970-0f21-45a9-957c-67f8d819b492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:07.202710 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665970-0f21-45a9-957c-67f8d819b492 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:07.203206 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665970-0f21-45a9-957c-67f8d819b492 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:07.203703 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db665970-0f21-45a9-957c-67f8d819b492 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:07.205132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db665970-0f21-45a9-957c-67f8d819b492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:07.205676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db665970-0f21-45a9-957c-67f8d819b492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:07.208348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db665970-0f21-45a9-957c-67f8d819b492 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:07.216223 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762cbc3c-ab1d-48a4-ace4-edf20422e292 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:07.236283 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:07.237244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 280/566] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:07.243741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db665970-0f21-45a9-957c-67f8d819b492 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:07.259002 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417587e-58fe-41a1-b0da-20d5123bdf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:07.260017 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417587e-58fe-41a1-b0da-20d5123bdf6b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:07.260483 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417587e-58fe-41a1-b0da-20d5123bdf6b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:07.260902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1417587e-58fe-41a1-b0da-20d5123bdf6b None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:07.261824 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417587e-58fe-41a1-b0da-20d5123bdf6b None admin] RBAC: Adding query filter params (name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:07.262281 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417587e-58fe-41a1-b0da-20d5123bdf6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:07.263866 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1417587e-58fe-41a1-b0da-20d5123bdf6b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:07.279062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 287/567] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:07.280367 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417587e-58fe-41a1-b0da-20d5123bdf6b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:07.398159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1417587e-58fe-41a1-b0da-20d5123bdf6b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:07.422127 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:07.441526 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e4c94-b066-4d23-898b-34a1dfd9856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:07.442641 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e4c94-b066-4d23-898b-34a1dfd9856e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:07.443069 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e4c94-b066-4d23-898b-34a1dfd9856e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:07.443497 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e4c94-b066-4d23-898b-34a1dfd9856e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:07.470970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db665970-0f21-45a9-957c-67f8d819b492 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:07.471184 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e4c94-b066-4d23-898b-34a1dfd9856e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:07.473999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e4c94-b066-4d23-898b-34a1dfd9856e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-7d9e4c94-b066-4d23-898b-34a1dfd9856e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:07.532374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:07.534216 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:07.535929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:07.535929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:07.535929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:07.535929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:07.539923 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 288/568] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:07.546168 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e4c94-b066-4d23-898b-34a1dfd9856e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:07.550272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdebfea-9ea1-467e-94d3-8cd0323a7aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:07.551288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdebfea-9ea1-467e-94d3-8cd0323a7aa9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:07.551678 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdebfea-9ea1-467e-94d3-8cd0323a7aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:07.552059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdebfea-9ea1-467e-94d3-8cd0323a7aa9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:07.566004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdebfea-9ea1-467e-94d3-8cd0323a7aa9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:07.571177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdebfea-9ea1-467e-94d3-8cd0323a7aa9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:07.599282 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-efdebfea-9ea1-467e-94d3-8cd0323a7aa9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:07.601900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:07.604114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:07.605938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:07.605938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:07.605938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:07.605938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:07.605938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:07.605938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:07.605938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:07.605938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:07.605938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:07.605938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:07.605938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 281/569] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:07.615089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdebfea-9ea1-467e-94d3-8cd0323a7aa9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:07.731735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdebfea-9ea1-467e-94d3-8cd0323a7aa9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:07.770853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db31777-05c1-41f6-81ab-fcff7866e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:07.771549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db31777-05c1-41f6-81ab-fcff7866e878 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:07.771835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db31777-05c1-41f6-81ab-fcff7866e878 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:07.772115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db31777-05c1-41f6-81ab-fcff7866e878 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:07.772829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e4c94-b066-4d23-898b-34a1dfd9856e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:07.773184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db31777-05c1-41f6-81ab-fcff7866e878 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:07.773511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db31777-05c1-41f6-81ab-fcff7866e878 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:07.774990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db31777-05c1-41f6-81ab-fcff7866e878 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:07.785270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:07.801064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 282/570] 10.222.0.24 () {56 vars in 1139 bytes} [Sat Jun 4 20:36:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:07.805653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db31777-05c1-41f6-81ab-fcff7866e878 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:07.849501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451ce02-2321-48cb-bfea-e75a336e8dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:07.851675 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451ce02-2321-48cb-bfea-e75a336e8dee None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:07.852619 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451ce02-2321-48cb-bfea-e75a336e8dee None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:07.853422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451ce02-2321-48cb-bfea-e75a336e8dee None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:07.855501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451ce02-2321-48cb-bfea-e75a336e8dee None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:07.856419 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451ce02-2321-48cb-bfea-e75a336e8dee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:07.859388 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451ce02-2321-48cb-bfea-e75a336e8dee None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:07.885903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 289/571] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:07.893446 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451ce02-2321-48cb-bfea-e75a336e8dee None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:07.995421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db31777-05c1-41f6-81ab-fcff7866e878 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:08.029640 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:08.038798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfd005-cc8d-4448-baa4-21b157c5ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:08.039997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd005-cc8d-4448-baa4-21b157c5ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:08.040507 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd005-cc8d-4448-baa4-21b157c5ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:08.040978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfd005-cc8d-4448-baa4-21b157c5ecc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:08.051207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451ce02-2321-48cb-bfea-e75a336e8dee None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:08.053033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfd005-cc8d-4448-baa4-21b157c5ecc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:08.055017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfd005-cc8d-4448-baa4-21b157c5ecc8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-4cbfd005-cc8d-4448-baa4-21b157c5ecc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:08.074589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:08.075533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:08.076509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:08.076509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:08.076509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:08.076509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:08.078846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 283/572] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:08.090706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfd005-cc8d-4448-baa4-21b157c5ecc8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:08.120396 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbabf3e-10f4-4cc5-8495-e7a8976ad7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:08.122013 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbabf3e-10f4-4cc5-8495-e7a8976ad7b5 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:08.122564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbabf3e-10f4-4cc5-8495-e7a8976ad7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:08.123240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbabf3e-10f4-4cc5-8495-e7a8976ad7b5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:08.139074 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbabf3e-10f4-4cc5-8495-e7a8976ad7b5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:08.142522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbabf3e-10f4-4cc5-8495-e7a8976ad7b5 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:08.163918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-9cbabf3e-10f4-4cc5-8495-e7a8976ad7b5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:08.176210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:08.177638 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:08.178565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:08.178565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:08.178565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:08.178565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:08.178565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:08.178565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:08.178565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:08.178565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:08.178565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:08.178565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:08.185449 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 290/573] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:08.187232 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbabf3e-10f4-4cc5-8495-e7a8976ad7b5 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:08.257622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfd005-cc8d-4448-baa4-21b157c5ecc8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:08.296856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a58659-c74d-40bc-857c-d7277f119ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:08.297970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a58659-c74d-40bc-857c-d7277f119ec0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:08.298473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a58659-c74d-40bc-857c-d7277f119ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:08.298949 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a58659-c74d-40bc-857c-d7277f119ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:08.299905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a58659-c74d-40bc-857c-d7277f119ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:08.300421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a58659-c74d-40bc-857c-d7277f119ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:08.302095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a58659-c74d-40bc-857c-d7277f119ec0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:08.320305 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 284/574] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:08.321687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a58659-c74d-40bc-857c-d7277f119ec0 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:08.390043 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbabf3e-10f4-4cc5-8495-e7a8976ad7b5 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:08.439445 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a58659-c74d-40bc-857c-d7277f119ec0 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:08.452115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:08.467056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249508c-2d6d-4857-8135-04a3b3613784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:08.468177 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249508c-2d6d-4857-8135-04a3b3613784 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:08.469558 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249508c-2d6d-4857-8135-04a3b3613784 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:08.470059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249508c-2d6d-4857-8135-04a3b3613784 None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:08.471319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249508c-2d6d-4857-8135-04a3b3613784 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:08.471960 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249508c-2d6d-4857-8135-04a3b3613784 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:08.473939 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249508c-2d6d-4857-8135-04a3b3613784 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:08.503894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9fae9-f803-4d13-bd4a-a043fba82839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:08.503894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9fae9-f803-4d13-bd4a-a043fba82839 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:08.503894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9fae9-f803-4d13-bd4a-a043fba82839 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:08.503894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9fae9-f803-4d13-bd4a-a043fba82839 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:08.504949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 291/575] 10.222.0.24 () {56 vars in 1137 bytes} [Sat Jun 4 20:36:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:08.506163 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249508c-2d6d-4857-8135-04a3b3613784 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:08.529072 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:08.530335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9fae9-f803-4d13-bd4a-a043fba82839 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:08.531663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9fae9-f803-4d13-bd4a-a043fba82839 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-5db9fae9-f803-4d13-bd4a-a043fba82839 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:08.547863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:08.549671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:08.551464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:08.551464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:08.551464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:08.551464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:08.551464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:08.551464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:08.551464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:08.551464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:08.554586 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 285/576] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:08.555371 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9fae9-f803-4d13-bd4a-a043fba82839 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:08.673726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9fae9-f803-4d13-bd4a-a043fba82839 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:08.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8acdc2-7491-4525-a874-1cdd429c9bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:08.715981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8acdc2-7491-4525-a874-1cdd429c9bb8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:08.716265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8acdc2-7491-4525-a874-1cdd429c9bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:08.716590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8acdc2-7491-4525-a874-1cdd429c9bb8 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:08.717415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8acdc2-7491-4525-a874-1cdd429c9bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:08.717751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8acdc2-7491-4525-a874-1cdd429c9bb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:08.719298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8acdc2-7491-4525-a874-1cdd429c9bb8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:08.730374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249508c-2d6d-4857-8135-04a3b3613784 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:08.738020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 286/577] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:08.739020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8acdc2-7491-4525-a874-1cdd429c9bb8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:08.775039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:08.800625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462643ac-9793-4725-abb9-ee23b250104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:08.802494 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462643ac-9793-4725-abb9-ee23b250104d None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:08.803272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462643ac-9793-4725-abb9-ee23b250104d None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:08.804103 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462643ac-9793-4725-abb9-ee23b250104d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:08.825196 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462643ac-9793-4725-abb9-ee23b250104d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:08.828389 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462643ac-9793-4725-abb9-ee23b250104d None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:08.858993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8acdc2-7491-4525-a874-1cdd429c9bb8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-462643ac-9793-4725-abb9-ee23b250104d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:08.864674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:08.866778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:08.868500 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:08.868500 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:08.868500 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:08.868500 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:08.872390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 292/578] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 366 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:08.877677 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462643ac-9793-4725-abb9-ee23b250104d None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:08.936182 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a5f12-d7f5-43b8-9dd8-23dc987fc105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:08.938324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a5f12-d7f5-43b8-9dd8-23dc987fc105 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:08.939117 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a5f12-d7f5-43b8-9dd8-23dc987fc105 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:08.939855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a5f12-d7f5-43b8-9dd8-23dc987fc105 None admin] PATH_INFO: `/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/75a7632fe5b5474ab6afd5b3d1bee4e6/roles/b3da02096234495595b953977e8296d3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:08.965712 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:08.972658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a5f12-d7f5-43b8-9dd8-23dc987fc105 None admin] RBAC: Authorizing `identity:create_grant(project_id=793a7b858d3848b3b0df4e9c31d20d2a, user_id=75a7632fe5b5474ab6afd5b3d1bee4e6, role_id=b3da02096234495595b953977e8296d3)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:08.976885 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a5f12-d7f5-43b8-9dd8-23dc987fc105 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:09.007586 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 287/579] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:36:08 2022] PUT /identity/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/75a7632fe5b5474ab6afd5b3d1bee4e6/roles/b3da02096234495595b953977e8296d3 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:36:09.041648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462643ac-9793-4725-abb9-ee23b250104d None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:09.118728 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24061364-3149-4477-8d07-ca9f2f180094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:09.120758 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24061364-3149-4477-8d07-ca9f2f180094 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.121694 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24061364-3149-4477-8d07-ca9f2f180094 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.122433 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24061364-3149-4477-8d07-ca9f2f180094 None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.124381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24061364-3149-4477-8d07-ca9f2f180094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:09.125418 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24061364-3149-4477-8d07-ca9f2f180094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:09.128379 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24061364-3149-4477-8d07-ca9f2f180094 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:09.154089 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 293/580] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:09.161685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a5f12-d7f5-43b8-9dd8-23dc987fc105 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:09.265281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:09.293205 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a5f12-d7f5-43b8-9dd8-23dc987fc105 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:09.334659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab6b17-ff7a-4d81-aadf-185ec71e21b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:09.335724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab6b17-ff7a-4d81-aadf-185ec71e21b3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.336016 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab6b17-ff7a-4d81-aadf-185ec71e21b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.336297 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab6b17-ff7a-4d81-aadf-185ec71e21b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.344650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab6b17-ff7a-4d81-aadf-185ec71e21b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:09.346158 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab6b17-ff7a-4d81-aadf-185ec71e21b3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-bfab6b17-ff7a-4d81-aadf-185ec71e21b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:09.361700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:09.363608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:09.365555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:09.365555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:09.365555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:09.365555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:09.365555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:09.365555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:09.365555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:09.365555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:09.365555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 288/581] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:09.370538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24061364-3149-4477-8d07-ca9f2f180094 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:09.467404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43bde-447c-4eec-8ec2-088b4fae3c36 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.468076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43bde-447c-4eec-8ec2-088b4fae3c36 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.468076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e43bde-447c-4eec-8ec2-088b4fae3c36 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.469760 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 289/582] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:09.478370 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c28d7-fc3c-4a96-9395-7fcff929629c None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.479000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c28d7-fc3c-4a96-9395-7fcff929629c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.479528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c28d7-fc3c-4a96-9395-7fcff929629c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.498131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-249c28d7-fc3c-4a96-9395-7fcff929629c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:09.499749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-249c28d7-fc3c-4a96-9395-7fcff929629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:09.503004 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24061364-3149-4477-8d07-ca9f2f180094 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:09.532481 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:09.551406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59161a-9dd1-48a5-b655-1aae1c7fe066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:09.552561 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59161a-9dd1-48a5-b655-1aae1c7fe066 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.553093 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59161a-9dd1-48a5-b655-1aae1c7fe066 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.553792 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59161a-9dd1-48a5-b655-1aae1c7fe066 None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.555243 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59161a-9dd1-48a5-b655-1aae1c7fe066 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:09.555850 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59161a-9dd1-48a5-b655-1aae1c7fe066 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:09.557663 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59161a-9dd1-48a5-b655-1aae1c7fe066 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:09.574870 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 294/583] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:09.581074 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59161a-9dd1-48a5-b655-1aae1c7fe066 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:09.606780 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 290/584] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:09.626675 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b9228-c6bf-40a5-9d03-06502898cb92 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.627105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b9228-c6bf-40a5-9d03-06502898cb92 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.627713 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b9228-c6bf-40a5-9d03-06502898cb92 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.637014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 291/585] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:09 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:09.640322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f382-260d-4abb-8343-5ce57433d75e None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.641194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f382-260d-4abb-8343-5ce57433d75e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.641647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958f382-260d-4abb-8343-5ce57433d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.674578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-b958f382-260d-4abb-8343-5ce57433d75e None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:09.676334 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-b958f382-260d-4abb-8343-5ce57433d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:09.719415 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59161a-9dd1-48a5-b655-1aae1c7fe066 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:09.765185 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986a9d6-3d10-407d-8be1-cc022e7da98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:09.766596 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986a9d6-3d10-407d-8be1-cc022e7da98c None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:09.767061 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986a9d6-3d10-407d-8be1-cc022e7da98c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:09.767524 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986a9d6-3d10-407d-8be1-cc022e7da98c None admin] PATH_INFO: `/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/eea7c50b99044720801876cce86e4311/roles/b3da02096234495595b953977e8296d3` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:09.768873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:09.784839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 292/586] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:09.786432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958f382-260d-4abb-8343-5ce57433d75e None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:09.796247 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986a9d6-3d10-407d-8be1-cc022e7da98c None admin] RBAC: Authorizing `identity:create_grant(project_id=793a7b858d3848b3b0df4e9c31d20d2a, user_id=eea7c50b99044720801876cce86e4311, role_id=b3da02096234495595b953977e8296d3)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:09.799727 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c986a9d6-3d10-407d-8be1-cc022e7da98c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:09.826290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 295/587] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:36:09 2022] PUT /identity/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/eea7c50b99044720801876cce86e4311/roles/b3da02096234495595b953977e8296d3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:36:09.828187 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986a9d6-3d10-407d-8be1-cc022e7da98c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:09.881624 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:09.979364 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958f382-260d-4abb-8343-5ce57433d75e None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.005728 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986a9d6-3d10-407d-8be1-cc022e7da98c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.024156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637239f-a26e-4814-8d66-9ef7b54a44f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.025449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637239f-a26e-4814-8d66-9ef7b54a44f7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.025922 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637239f-a26e-4814-8d66-9ef7b54a44f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.026373 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637239f-a26e-4814-8d66-9ef7b54a44f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.040404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637239f-a26e-4814-8d66-9ef7b54a44f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-0637239f-a26e-4814-8d66-9ef7b54a44f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:10.049118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:10.050126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:10.050986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:10.053950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 293/588] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:10.065075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637239f-a26e-4814-8d66-9ef7b54a44f7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.100903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a24a48-4e49-4e85-ae65-629c4109776f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.102161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a24a48-4e49-4e85-ae65-629c4109776f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.102664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a24a48-4e49-4e85-ae65-629c4109776f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.103405 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a24a48-4e49-4e85-ae65-629c4109776f None admin] PATH_INFO: `/v3/roles/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.118100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a24a48-4e49-4e85-ae65-629c4109776f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-63a24a48-4e49-4e85-ae65-629c4109776f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:10.126752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:10.127741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:10.128593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:10.131146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 296/589] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:10.137991 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a24a48-4e49-4e85-ae65-629c4109776f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.168093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:10.250901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637239f-a26e-4814-8d66-9ef7b54a44f7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.287843 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:10.302789 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a24a48-4e49-4e85-ae65-629c4109776f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.305648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d466b5-4e92-4c1f-af69-1b5d48bfd98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.308595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d466b5-4e92-4c1f-af69-1b5d48bfd98d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.309422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d466b5-4e92-4c1f-af69-1b5d48bfd98d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.310185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d466b5-4e92-4c1f-af69-1b5d48bfd98d None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.311879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d466b5-4e92-4c1f-af69-1b5d48bfd98d None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:10.313603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d466b5-4e92-4c1f-af69-1b5d48bfd98d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:10.317403 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d466b5-4e92-4c1f-af69-1b5d48bfd98d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:10.343848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 294/590] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:10.345049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d466b5-4e92-4c1f-af69-1b5d48bfd98d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.383695 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d99e0-e2bf-4225-b7b3-58903082c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.384525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d99e0-e2bf-4225-b7b3-58903082c898 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.384876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d99e0-e2bf-4225-b7b3-58903082c898 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.385218 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d99e0-e2bf-4225-b7b3-58903082c898 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.386071 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d99e0-e2bf-4225-b7b3-58903082c898 None admin] RBAC: Adding query filter params (name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:10.386723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d99e0-e2bf-4225-b7b3-58903082c898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:10.388363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d99e0-e2bf-4225-b7b3-58903082c898 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:10.400215 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 297/591] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:10.405633 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d99e0-e2bf-4225-b7b3-58903082c898 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.548026 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d466b5-4e92-4c1f-af69-1b5d48bfd98d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.583957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:10.607353 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d99e0-e2bf-4225-b7b3-58903082c898 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.610733 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b7706-8cac-4663-8718-af4f61e45832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.612365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b7706-8cac-4663-8718-af4f61e45832 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.612999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b7706-8cac-4663-8718-af4f61e45832 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.614890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b7706-8cac-4663-8718-af4f61e45832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.645948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b7706-8cac-4663-8718-af4f61e45832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:10.649077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b7706-8cac-4663-8718-af4f61e45832 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:10.658202 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65702a89-52a8-438e-84d0-5e58cbda9b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.659429 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65702a89-52a8-438e-84d0-5e58cbda9b5f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.659954 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65702a89-52a8-438e-84d0-5e58cbda9b5f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.660414 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65702a89-52a8-438e-84d0-5e58cbda9b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.674538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65702a89-52a8-438e-84d0-5e58cbda9b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:10.676384 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65702a89-52a8-438e-84d0-5e58cbda9b5f None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-8e9b7706-8cac-4663-8718-af4f61e45832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:10.684474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:10.685582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:10.686450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:10.686450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:10.686450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:10.686450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:10.693127 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 295/592] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:10.696872 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b7706-8cac-4663-8718-af4f61e45832 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-65702a89-52a8-438e-84d0-5e58cbda9b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:10.700957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:10.701876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:10.702761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:10.702761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:10.702761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:10.702761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:10.705239 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 298/593] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:10.711214 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65702a89-52a8-438e-84d0-5e58cbda9b5f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.715449 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:10.829091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65702a89-52a8-438e-84d0-5e58cbda9b5f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.879177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b7706-8cac-4663-8718-af4f61e45832 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:10.911028 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bcb38-535f-4db2-ba77-ee19465f4b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.912815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bcb38-535f-4db2-ba77-ee19465f4b5c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.913401 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bcb38-535f-4db2-ba77-ee19465f4b5c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.913891 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01bcb38-535f-4db2-ba77-ee19465f4b5c None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.915623 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bcb38-535f-4db2-ba77-ee19465f4b5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:10.916517 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bcb38-535f-4db2-ba77-ee19465f4b5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:10.920630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01bcb38-535f-4db2-ba77-ee19465f4b5c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:10.927005 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64da5b-ff86-448b-bc16-98dd43242b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:10.928538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64da5b-ff86-448b-bc16-98dd43242b37 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:10.929162 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64da5b-ff86-448b-bc16-98dd43242b37 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:10.929635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64da5b-ff86-448b-bc16-98dd43242b37 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:10.930752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64da5b-ff86-448b-bc16-98dd43242b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:10.931250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64da5b-ff86-448b-bc16-98dd43242b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:10.932921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a64da5b-ff86-448b-bc16-98dd43242b37 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:10.955754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 299/595] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:10.957212 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bcb38-535f-4db2-ba77-ee19465f4b5c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:10.957888 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 296/595] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:10.963564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64da5b-ff86-448b-bc16-98dd43242b37 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:11.029902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:11.038634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:11.076230 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01bcb38-535f-4db2-ba77-ee19465f4b5c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.118950 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f22562-7238-4675-b6ce-77fea76764f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.120062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f22562-7238-4675-b6ce-77fea76764f2 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.120537 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f22562-7238-4675-b6ce-77fea76764f2 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.120967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f22562-7238-4675-b6ce-77fea76764f2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.129987 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f22562-7238-4675-b6ce-77fea76764f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.131902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f22562-7238-4675-b6ce-77fea76764f2 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-f4f22562-7238-4675-b6ce-77fea76764f2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:11.148875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:11.150037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:11.151040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:11.151040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:11.151040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:11.151040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:11.151040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:11.151040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:11.151040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:11.151040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:11.151040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 04 20:36:11.151040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:11.157816 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 300/596] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:11.159090 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f22562-7238-4675-b6ce-77fea76764f2 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:11.188322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64da5b-ff86-448b-bc16-98dd43242b37 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.255477 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73011ce7-777b-4593-844d-e65b092ee24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.257038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73011ce7-777b-4593-844d-e65b092ee24a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.257557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73011ce7-777b-4593-844d-e65b092ee24a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.258055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73011ce7-777b-4593-844d-e65b092ee24a None admin] PATH_INFO: `/v3/users/nova` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.274238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73011ce7-777b-4593-844d-e65b092ee24a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.277359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73011ce7-777b-4593-844d-e65b092ee24a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.278800 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f22562-7238-4675-b6ce-77fea76764f2 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.307472 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-73011ce7-777b-4593-844d-e65b092ee24a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:11.308264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:11.311756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:11.313094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:11.313094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:11.313094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:11.313094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:11.313094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:11.313094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:11.313094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:11.313094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:11.313094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:11.313094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:11.314909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 297/597] 10.222.0.24 () {56 vars in 1093 bytes} [Sat Jun 4 20:36:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:11.315949 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73011ce7-777b-4593-844d-e65b092ee24a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:11.323835 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991cb00-7569-4ee1-a41d-acdad7d669d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.324877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991cb00-7569-4ee1-a41d-acdad7d669d9 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.325312 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991cb00-7569-4ee1-a41d-acdad7d669d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.325734 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8991cb00-7569-4ee1-a41d-acdad7d669d9 None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.326749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991cb00-7569-4ee1-a41d-acdad7d669d9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:11.327212 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991cb00-7569-4ee1-a41d-acdad7d669d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.328904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8991cb00-7569-4ee1-a41d-acdad7d669d9 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.350050 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 301/598] 10.222.0.24 () {56 vars in 1137 bytes} [Sat Jun 4 20:36:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:11.356221 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991cb00-7569-4ee1-a41d-acdad7d669d9 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:11.444550 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:11.464193 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73011ce7-777b-4593-844d-e65b092ee24a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.530379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b11dda-93cc-43d8-96af-73f19592dae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.531081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b11dda-93cc-43d8-96af-73f19592dae9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.531368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b11dda-93cc-43d8-96af-73f19592dae9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.531647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b11dda-93cc-43d8-96af-73f19592dae9 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.532558 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b11dda-93cc-43d8-96af-73f19592dae9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:11.532869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b11dda-93cc-43d8-96af-73f19592dae9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.534489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b11dda-93cc-43d8-96af-73f19592dae9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.555799 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 298/599] 10.222.0.24 () {56 vars in 1133 bytes} [Sat Jun 4 20:36:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:11.563789 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b11dda-93cc-43d8-96af-73f19592dae9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:11.584029 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8991cb00-7569-4ee1-a41d-acdad7d669d9 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.657455 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871a348-8bcf-401c-853f-ceb696763c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.658975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871a348-8bcf-401c-853f-ceb696763c90 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.659445 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871a348-8bcf-401c-853f-ceb696763c90 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.660334 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871a348-8bcf-401c-853f-ceb696763c90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.724860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b11dda-93cc-43d8-96af-73f19592dae9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:11.740932 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:11.771549 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871a348-8bcf-401c-853f-ceb696763c90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.773738 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871a348-8bcf-401c-853f-ceb696763c90 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.796548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b45225-0ecf-42ca-9ed4-a33ce7042529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:11.798250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45225-0ecf-42ca-9ed4-a33ce7042529 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:11.798925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45225-0ecf-42ca-9ed4-a33ce7042529 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:11.799492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45225-0ecf-42ca-9ed4-a33ce7042529 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:11.847023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:11.913778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b45225-0ecf-42ca-9ed4-a33ce7042529 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:11.915611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b45225-0ecf-42ca-9ed4-a33ce7042529 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:11.981245 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 302/600] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 625 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:11.983165 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871a348-8bcf-401c-853f-ceb696763c90 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.097014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 299/601] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:12.102093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b45225-0ecf-42ca-9ed4-a33ce7042529 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.156028 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:12.206030 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871a348-8bcf-401c-853f-ceb696763c90 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.223708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:12.302004 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507bcf6b-524e-4bac-8dee-cc461da99e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.304384 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bcf6b-524e-4bac-8dee-cc461da99e4b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.305203 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bcf6b-524e-4bac-8dee-cc461da99e4b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.306752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507bcf6b-524e-4bac-8dee-cc461da99e4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.334652 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bcf6b-524e-4bac-8dee-cc461da99e4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:12.339556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507bcf6b-524e-4bac-8dee-cc461da99e4b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:12.342204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b45225-0ecf-42ca-9ed4-a33ce7042529 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-507bcf6b-524e-4bac-8dee-cc461da99e4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:12.379642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:12.381095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:12.390621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:12.390621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:12.390621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:12.390621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:12.390621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 303/602] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 400 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:12.390621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d3104-50b1-45e7-a5d5-e76fb86b6890 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.390621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d3104-50b1-45e7-a5d5-e76fb86b6890 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.390621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d3104-50b1-45e7-a5d5-e76fb86b6890 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.390621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 304/603] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:12.396167 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcacf13-426a-4d93-9b7a-81187e490feb None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.396636 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcacf13-426a-4d93-9b7a-81187e490feb None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.397312 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcacf13-426a-4d93-9b7a-81187e490feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.415371 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894997e7-788e-471d-8712-d54df936ce0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.417020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894997e7-788e-471d-8712-d54df936ce0f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.417781 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894997e7-788e-471d-8712-d54df936ce0f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.418478 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894997e7-788e-471d-8712-d54df936ce0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.424760 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-ddcacf13-426a-4d93-9b7a-81187e490feb None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:12.426677 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-ddcacf13-426a-4d93-9b7a-81187e490feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:12.439295 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894997e7-788e-471d-8712-d54df936ce0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:12.442083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894997e7-788e-471d-8712-d54df936ce0f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-894997e7-788e-471d-8712-d54df936ce0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:12.474389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:12.476225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:12.477541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:12.477541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:12.477541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:12.477541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:12.477541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 300/604] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:12.479114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894997e7-788e-471d-8712-d54df936ce0f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.548507 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 305/605] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:12.548507 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcacf13-426a-4d93-9b7a-81187e490feb None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.649333 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:12.659403 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894997e7-788e-471d-8712-d54df936ce0f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.662380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:12.709360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cc2fc-1ed3-44c0-882a-9d647f619cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.710346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc2fc-1ed3-44c0-882a-9d647f619cdc None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.710752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc2fc-1ed3-44c0-882a-9d647f619cdc None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.711147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086cc2fc-1ed3-44c0-882a-9d647f619cdc None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.712061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cc2fc-1ed3-44c0-882a-9d647f619cdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:12.712601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cc2fc-1ed3-44c0-882a-9d647f619cdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:12.714357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086cc2fc-1ed3-44c0-882a-9d647f619cdc None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:12.728591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 301/606] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:12.735175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cc2fc-1ed3-44c0-882a-9d647f619cdc None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.735311 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcacf13-426a-4d93-9b7a-81187e490feb None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.774700 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796ee07-5037-4172-bb10-85013843e24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.775473 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796ee07-5037-4172-bb10-85013843e24d None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.775847 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796ee07-5037-4172-bb10-85013843e24d None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.776248 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796ee07-5037-4172-bb10-85013843e24d None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.777403 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796ee07-5037-4172-bb10-85013843e24d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:12.777827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796ee07-5037-4172-bb10-85013843e24d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:12.779430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796ee07-5037-4172-bb10-85013843e24d None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:12.792915 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 306/607] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:12.794331 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17633da5-8735-4a26-addc-35cc81f56320 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.794693 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17633da5-8735-4a26-addc-35cc81f56320 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.794994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17633da5-8735-4a26-addc-35cc81f56320 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.796327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 307/608] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:12.797142 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17633da5-8735-4a26-addc-35cc81f56320 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.873452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086cc2fc-1ed3-44c0-882a-9d647f619cdc None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.917475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17633da5-8735-4a26-addc-35cc81f56320 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:12.931974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d4c6-db4e-4253-aaa4-c8f51ff157eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.932954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d4c6-db4e-4253-aaa4-c8f51ff157eb None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.933289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d4c6-db4e-4253-aaa4-c8f51ff157eb None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.933764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d31d4c6-db4e-4253-aaa4-c8f51ff157eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.947058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d31d4c6-db4e-4253-aaa4-c8f51ff157eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:12.951507 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-5d31d4c6-db4e-4253-aaa4-c8f51ff157eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:12.955290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:12.956595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 302/609] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:12.958000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d4c6-db4e-4253-aaa4-c8f51ff157eb None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:12.975656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8bde1d-2db3-40e5-b3d3-c8774d4d017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:12.976713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bde1d-2db3-40e5-b3d3-c8774d4d017c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:12.977110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bde1d-2db3-40e5-b3d3-c8774d4d017c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:12.977470 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8bde1d-2db3-40e5-b3d3-c8774d4d017c None admin] PATH_INFO: `/v3/projects/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:12.988175 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bde1d-2db3-40e5-b3d3-c8774d4d017c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:12.990102 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8bde1d-2db3-40e5-b3d3-c8774d4d017c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:12.990923 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-3e8bde1d-2db3-40e5-b3d3-c8774d4d017c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:13.007994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:13.009788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:13.011634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:13.011634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:13.011634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:13.011634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:13.011634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:13.011634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:13.011634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:13.011634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:13.011634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 308/610] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:13.011634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a6aae-1316-44fc-a848-42e820e22ef7 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.011634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a6aae-1316-44fc-a848-42e820e22ef7 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.012864 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5a6aae-1316-44fc-a848-42e820e22ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.031073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-4c5a6aae-1316-44fc-a848-42e820e22ef7 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:13.032337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-4c5a6aae-1316-44fc-a848-42e820e22ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:13.097147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d31d4c6-db4e-4253-aaa4-c8f51ff157eb None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.152479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 309/611] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:13.152830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b35a2-f921-4248-a863-9f0846c06782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.153016 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a6aae-1316-44fc-a848-42e820e22ef7 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.153170 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b35a2-f921-4248-a863-9f0846c06782 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.153170 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b35a2-f921-4248-a863-9f0846c06782 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.153170 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b35a2-f921-4248-a863-9f0846c06782 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.156626 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b35a2-f921-4248-a863-9f0846c06782 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.161308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b35a2-f921-4248-a863-9f0846c06782 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-f91b35a2-f921-4248-a863-9f0846c06782 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:13.192316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:13.193601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:13.194992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:13.194992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:13.194992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:13.194992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:13.194992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:13.194992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:13.194992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:13.194992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:13.194992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 303/612] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:13.195916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b35a2-f921-4248-a863-9f0846c06782 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.291360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.309832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b35a2-f921-4248-a863-9f0846c06782 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.331650 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5a6aae-1316-44fc-a848-42e820e22ef7 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.347295 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fde8a-d915-458d-81d8-a0116708c355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.347985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fde8a-d915-458d-81d8-a0116708c355 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.348264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fde8a-d915-458d-81d8-a0116708c355 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.348573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0fde8a-d915-458d-81d8-a0116708c355 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.349389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fde8a-d915-458d-81d8-a0116708c355 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:13.349690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fde8a-d915-458d-81d8-a0116708c355 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.351354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0fde8a-d915-458d-81d8-a0116708c355 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.356487 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.365644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 304/613] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:13.366612 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fde8a-d915-458d-81d8-a0116708c355 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.401371 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4910ba9-f8fe-447a-bf6b-d109eb4784dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.402208 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910ba9-f8fe-447a-bf6b-d109eb4784dc None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.402602 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910ba9-f8fe-447a-bf6b-d109eb4784dc None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.403013 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910ba9-f8fe-447a-bf6b-d109eb4784dc None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.404083 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4910ba9-f8fe-447a-bf6b-d109eb4784dc None admin] RBAC: Adding query filter params (name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:13.404556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4910ba9-f8fe-447a-bf6b-d109eb4784dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.406094 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4910ba9-f8fe-447a-bf6b-d109eb4784dc None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.424008 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 310/614] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:13.424008 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4910ba9-f8fe-447a-bf6b-d109eb4784dc None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.487041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0fde8a-d915-458d-81d8-a0116708c355 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.543236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5ef4d-99d2-4923-849c-263cb56d54f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.544516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5ef4d-99d2-4923-849c-263cb56d54f6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.544946 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5ef4d-99d2-4923-849c-263cb56d54f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.545388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5ef4d-99d2-4923-849c-263cb56d54f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.557459 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4910ba9-f8fe-447a-bf6b-d109eb4784dc None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.563653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b5ef4d-99d2-4923-849c-263cb56d54f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-a5b5ef4d-99d2-4923-849c-263cb56d54f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:13.578136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:13.579192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:36:13.580035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:13.581249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 305/615] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:13.581249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5ef4d-99d2-4923-849c-263cb56d54f6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.592604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.615920 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978a8ea-0530-4d9a-9fda-a05877589b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.617336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a8ea-0530-4d9a-9fda-a05877589b8f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.617336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a8ea-0530-4d9a-9fda-a05877589b8f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.617687 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a8ea-0530-4d9a-9fda-a05877589b8f None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.618503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978a8ea-0530-4d9a-9fda-a05877589b8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:13.618965 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978a8ea-0530-4d9a-9fda-a05877589b8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.620800 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978a8ea-0530-4d9a-9fda-a05877589b8f None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.637818 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 311/616] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:13.638974 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978a8ea-0530-4d9a-9fda-a05877589b8f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.682567 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.733608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b5ef4d-99d2-4923-849c-263cb56d54f6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.763863 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978a8ea-0530-4d9a-9fda-a05877589b8f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:13.781317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f4aee-41c6-4156-8489-557bdd383037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.782480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f4aee-41c6-4156-8489-557bdd383037 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.782982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f4aee-41c6-4156-8489-557bdd383037 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.783476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f4aee-41c6-4156-8489-557bdd383037 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.785178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f4aee-41c6-4156-8489-557bdd383037 None admin] RBAC: Adding query filter params (role.id=b3da02096234495595b953977e8296d3, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=070dbe04e894424f99365e998376144e) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:13.785741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f4aee-41c6-4156-8489-557bdd383037 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.788578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f4aee-41c6-4156-8489-557bdd383037 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.800077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 306/617] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/role_assignments?user.id=070dbe04e894424f99365e998376144e&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=b3da02096234495595b953977e8296d3 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:13.801634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f4aee-41c6-4156-8489-557bdd383037 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.804482 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dce073-9502-4caf-809d-1bc37c47b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:13.805620 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dce073-9502-4caf-809d-1bc37c47b197 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:13.806092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dce073-9502-4caf-809d-1bc37c47b197 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:13.806561 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dce073-9502-4caf-809d-1bc37c47b197 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:13.823489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dce073-9502-4caf-809d-1bc37c47b197 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:13.825725 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dce073-9502-4caf-809d-1bc37c47b197 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-c0dce073-9502-4caf-809d-1bc37c47b197 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:13.850119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:13.852828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:13.854538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:13.854538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:13.854538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:13.854538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:13.854538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 312/618] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:13.855486 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dce073-9502-4caf-809d-1bc37c47b197 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:13.921651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:13.983016 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f4aee-41c6-4156-8489-557bdd383037 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:14.034708 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:14.036075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfac961-6c64-4550-bc2a-bc716cf10494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.036845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfac961-6c64-4550-bc2a-bc716cf10494 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.037264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfac961-6c64-4550-bc2a-bc716cf10494 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.037413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfac961-6c64-4550-bc2a-bc716cf10494 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.038865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfac961-6c64-4550-bc2a-bc716cf10494 None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:14.039382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfac961-6c64-4550-bc2a-bc716cf10494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.040833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfac961-6c64-4550-bc2a-bc716cf10494 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.058095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 307/619] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:14.058095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfac961-6c64-4550-bc2a-bc716cf10494 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:14.068046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dce073-9502-4caf-809d-1bc37c47b197 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:14.135353 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8a192-8c1c-4413-9936-6ff8c3f20e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.136389 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a192-8c1c-4413-9936-6ff8c3f20e2b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.136896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a192-8c1c-4413-9936-6ff8c3f20e2b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.137341 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd8a192-8c1c-4413-9936-6ff8c3f20e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.138327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8a192-8c1c-4413-9936-6ff8c3f20e2b None admin] RBAC: Adding query filter params (role.id=b3da02096234495595b953977e8296d3, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=b82d01982ea7412aa396b517ed80bd4c) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:14.138682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8a192-8c1c-4413-9936-6ff8c3f20e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.141068 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd8a192-8c1c-4413-9936-6ff8c3f20e2b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.151019 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 313/620] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:13 2022] GET /identity/v3/role_assignments?user.id=b82d01982ea7412aa396b517ed80bd4c&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=b3da02096234495595b953977e8296d3 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:14.152944 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8a192-8c1c-4413-9936-6ff8c3f20e2b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:14.247385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfac961-6c64-4550-bc2a-bc716cf10494 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:14.300770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:14.315775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb9f90-9c02-4e38-96d7-6687f7733e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.316829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb9f90-9c02-4e38-96d7-6687f7733e37 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.317233 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb9f90-9c02-4e38-96d7-6687f7733e37 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.317706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb9f90-9c02-4e38-96d7-6687f7733e37 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.319077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb9f90-9c02-4e38-96d7-6687f7733e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:14.320194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb9f90-9c02-4e38-96d7-6687f7733e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.322735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb9f90-9c02-4e38-96d7-6687f7733e37 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.351776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 308/621] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:14.361362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb9f90-9c02-4e38-96d7-6687f7733e37 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:14.380479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd8a192-8c1c-4413-9936-6ff8c3f20e2b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:14.441541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886488a9-7c5e-431d-a9b2-4dd32f5c9a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.442842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886488a9-7c5e-431d-a9b2-4dd32f5c9a50 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.443293 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886488a9-7c5e-431d-a9b2-4dd32f5c9a50 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.443743 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886488a9-7c5e-431d-a9b2-4dd32f5c9a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.465084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886488a9-7c5e-431d-a9b2-4dd32f5c9a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.468704 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886488a9-7c5e-431d-a9b2-4dd32f5c9a50 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-886488a9-7c5e-431d-a9b2-4dd32f5c9a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:14.507207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:14.508805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:14.510807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:14.510807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:14.510807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:14.510807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:14.510807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 314/622] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:14.521085 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886488a9-7c5e-431d-a9b2-4dd32f5c9a50 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:14.532485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:14.585607 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb9f90-9c02-4e38-96d7-6687f7733e37 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:14.638195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04bf7-818d-494b-9fbc-3de81f78b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.640600 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04bf7-818d-494b-9fbc-3de81f78b945 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.641058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04bf7-818d-494b-9fbc-3de81f78b945 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.641485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a04bf7-818d-494b-9fbc-3de81f78b945 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.658320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a04bf7-818d-494b-9fbc-3de81f78b945 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.661106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a04bf7-818d-494b-9fbc-3de81f78b945 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-30a04bf7-818d-494b-9fbc-3de81f78b945 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:14.681856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:14.682881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:14.683835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:14.683835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:14.683835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:14.683835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:14.683835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:14.683835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:14.683835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:14.683835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:14.683835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:14.683835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:14.686905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 309/623] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:14.696038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04bf7-818d-494b-9fbc-3de81f78b945 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:14.738670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886488a9-7c5e-431d-a9b2-4dd32f5c9a50 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:14.760582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:14.803591 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80169ad8-74ab-4688-be14-46455e840a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.805096 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80169ad8-74ab-4688-be14-46455e840a19 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.805592 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80169ad8-74ab-4688-be14-46455e840a19 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.806072 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80169ad8-74ab-4688-be14-46455e840a19 None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.807492 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80169ad8-74ab-4688-be14-46455e840a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:14.808005 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80169ad8-74ab-4688-be14-46455e840a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.810591 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80169ad8-74ab-4688-be14-46455e840a19 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.834014 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 315/624] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:14.843453 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80169ad8-74ab-4688-be14-46455e840a19 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:14.864889 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a04bf7-818d-494b-9fbc-3de81f78b945 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:14.936904 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fee220-d0dc-45db-b9a5-bdeb93140933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:14.938367 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fee220-d0dc-45db-b9a5-bdeb93140933 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:14.939132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fee220-d0dc-45db-b9a5-bdeb93140933 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:14.939859 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fee220-d0dc-45db-b9a5-bdeb93140933 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:14.941728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fee220-d0dc-45db-b9a5-bdeb93140933 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:14.942530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fee220-d0dc-45db-b9a5-bdeb93140933 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:14.945976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fee220-d0dc-45db-b9a5-bdeb93140933 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:14.946257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:14.984774 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 310/625] 10.222.0.24 () {56 vars in 1137 bytes} [Sat Jun 4 20:36:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:14.992885 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fee220-d0dc-45db-b9a5-bdeb93140933 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:15.009750 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80169ad8-74ab-4688-be14-46455e840a19 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:15.070625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1265ca6-e4a9-4482-8d61-3db55a423084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:15.071819 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1265ca6-e4a9-4482-8d61-3db55a423084 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:15.072102 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1265ca6-e4a9-4482-8d61-3db55a423084 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:15.072376 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1265ca6-e4a9-4482-8d61-3db55a423084 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:15.082623 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1265ca6-e4a9-4482-8d61-3db55a423084 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:15.085019 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1265ca6-e4a9-4482-8d61-3db55a423084 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-a1265ca6-e4a9-4482-8d61-3db55a423084 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:15.107682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:15.109742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:15.111807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:15.111807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:15.111807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:15.111807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:15.111807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:15.111807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:15.111807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:15.111807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:15.111807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 04 20:36:15.111807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:15.111807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 316/626] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:36:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:15.114318 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1265ca6-e4a9-4482-8d61-3db55a423084 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:15.192251 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fee220-d0dc-45db-b9a5-bdeb93140933 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:15.207356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:15.243305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1265ca6-e4a9-4482-8d61-3db55a423084 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:15.245497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d8e40-b42c-4323-9ed2-3c99361946fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:15.247444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d8e40-b42c-4323-9ed2-3c99361946fa None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:15.247901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d8e40-b42c-4323-9ed2-3c99361946fa None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:15.248325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d8e40-b42c-4323-9ed2-3c99361946fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:15.273812 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:15.287838 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d10643-6647-43e0-9a4b-3febb479721e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:15.289346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d10643-6647-43e0-9a4b-3febb479721e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:15.289787 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d10643-6647-43e0-9a4b-3febb479721e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:15.290207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d10643-6647-43e0-9a4b-3febb479721e None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:15.291244 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d10643-6647-43e0-9a4b-3febb479721e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:15.291779 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d10643-6647-43e0-9a4b-3febb479721e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:15.293418 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d10643-6647-43e0-9a4b-3febb479721e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:15.316059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 317/627] 10.222.0.24 () {56 vars in 1139 bytes} [Sat Jun 4 20:36:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:15.321892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d10643-6647-43e0-9a4b-3febb479721e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:15.332337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d8e40-b42c-4323-9ed2-3c99361946fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:15.334050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d8e40-b42c-4323-9ed2-3c99361946fa None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:15.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 311/628] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:15.459932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d8e40-b42c-4323-9ed2-3c99361946fa None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:15.473099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:15.490966 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d10643-6647-43e0-9a4b-3febb479721e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:15.542011 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed85993-a0e5-4145-a5d7-7edf4b448a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:15.543201 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed85993-a0e5-4145-a5d7-7edf4b448a94 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:15.543637 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed85993-a0e5-4145-a5d7-7edf4b448a94 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:15.544197 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed85993-a0e5-4145-a5d7-7edf4b448a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:15.587057 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d8e40-b42c-4323-9ed2-3c99361946fa None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:15.618576 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:15.637384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aee43-0e34-425b-8378-0fd6c99126ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:15.638473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aee43-0e34-425b-8378-0fd6c99126ea None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:15.638962 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aee43-0e34-425b-8378-0fd6c99126ea None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:15.639409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95aee43-0e34-425b-8378-0fd6c99126ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:15.644069 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed85993-a0e5-4145-a5d7-7edf4b448a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:15.645835 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed85993-a0e5-4145-a5d7-7edf4b448a94 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:15.656200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aee43-0e34-425b-8378-0fd6c99126ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:15.658542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95aee43-0e34-425b-8378-0fd6c99126ea None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-b95aee43-0e34-425b-8378-0fd6c99126ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:15.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:15.685852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:15.686808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:15.686808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:15.686808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:15.686808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:15.689888 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 312/629] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:15.695491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aee43-0e34-425b-8378-0fd6c99126ea None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:15.782138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:15.792211 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 318/630] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 04 20:36:15.798138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed85993-a0e5-4145-a5d7-7edf4b448a94 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:15.833669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95aee43-0e34-425b-8378-0fd6c99126ea None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:15.877896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1764c89-a351-4cc1-8a19-8e46e69154ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:15.879556 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1764c89-a351-4cc1-8a19-8e46e69154ec None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:15.880133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1764c89-a351-4cc1-8a19-8e46e69154ec None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:15.880852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1764c89-a351-4cc1-8a19-8e46e69154ec None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:15.882086 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1764c89-a351-4cc1-8a19-8e46e69154ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:15.882699 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1764c89-a351-4cc1-8a19-8e46e69154ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:15.884770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1764c89-a351-4cc1-8a19-8e46e69154ec None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:15.902036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 313/631] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:15.910732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1764c89-a351-4cc1-8a19-8e46e69154ec None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:15.951532 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:15.969199 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed85993-a0e5-4145-a5d7-7edf4b448a94 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:16.017471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a381105-e3af-490f-a294-6ca308735374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:16.018412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a381105-e3af-490f-a294-6ca308735374 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.018729 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a381105-e3af-490f-a294-6ca308735374 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.020714 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a381105-e3af-490f-a294-6ca308735374 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.033873 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a381105-e3af-490f-a294-6ca308735374 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:16.035643 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a381105-e3af-490f-a294-6ca308735374 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-3a381105-e3af-490f-a294-6ca308735374 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:16.066063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:16.067849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:16.071221 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:16.071221 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:16.071221 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:16.071221 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:16.081011 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 319/632] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:16.084144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a381105-e3af-490f-a294-6ca308735374 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:16.103186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1764c89-a351-4cc1-8a19-8e46e69154ec None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:16.131555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:16.152671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32175c42-53aa-41d1-8c43-0b529411f7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:16.154528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32175c42-53aa-41d1-8c43-0b529411f7b4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.154829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32175c42-53aa-41d1-8c43-0b529411f7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.155109 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32175c42-53aa-41d1-8c43-0b529411f7b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.168784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32175c42-53aa-41d1-8c43-0b529411f7b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:16.171001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32175c42-53aa-41d1-8c43-0b529411f7b4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-32175c42-53aa-41d1-8c43-0b529411f7b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:16.195711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:16.197783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:16.199509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:16.199509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:16.199509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:16.199509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:16.199509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:16.199509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:16.199509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:16.199509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:16.208972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 314/633] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:16.213816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32175c42-53aa-41d1-8c43-0b529411f7b4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:16.250250 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a381105-e3af-490f-a294-6ca308735374 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:16.296714 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486ded9-b606-406f-a1c3-f1d7c531e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:16.297288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486ded9-b606-406f-a1c3-f1d7c531e27e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.297566 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486ded9-b606-406f-a1c3-f1d7c531e27e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.297844 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7486ded9-b606-406f-a1c3-f1d7c531e27e None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.298922 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486ded9-b606-406f-a1c3-f1d7c531e27e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:16.299234 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486ded9-b606-406f-a1c3-f1d7c531e27e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:16.300678 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7486ded9-b606-406f-a1c3-f1d7c531e27e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:16.302417 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:16.323543 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 320/634] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:16.326503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486ded9-b606-406f-a1c3-f1d7c531e27e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:16.395573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32175c42-53aa-41d1-8c43-0b529411f7b4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:16.442413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e2685-5ac2-428b-9500-4cf8ec2a30d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:16.443107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e2685-5ac2-428b-9500-4cf8ec2a30d5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.443389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e2685-5ac2-428b-9500-4cf8ec2a30d5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.443668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e2685-5ac2-428b-9500-4cf8ec2a30d5 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.444629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e2685-5ac2-428b-9500-4cf8ec2a30d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:16.444946 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e2685-5ac2-428b-9500-4cf8ec2a30d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:16.446901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e2685-5ac2-428b-9500-4cf8ec2a30d5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:16.464486 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 315/635] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:16.472817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e2685-5ac2-428b-9500-4cf8ec2a30d5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:16.528412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:16.549415 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7486ded9-b606-406f-a1c3-f1d7c531e27e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:16.617059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e2685-5ac2-428b-9500-4cf8ec2a30d5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:16.617718 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdc71af-e63d-4e7b-950c-73eb28d6a286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:16.619363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc71af-e63d-4e7b-950c-73eb28d6a286 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.620130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc71af-e63d-4e7b-950c-73eb28d6a286 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.620942 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdc71af-e63d-4e7b-950c-73eb28d6a286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.635307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc71af-e63d-4e7b-950c-73eb28d6a286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:16.638609 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdc71af-e63d-4e7b-950c-73eb28d6a286 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:16.659264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae8c3-790f-4545-a574-1398fc378062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:16.659939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae8c3-790f-4545-a574-1398fc378062 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.660236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae8c3-790f-4545-a574-1398fc378062 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.660541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ae8c3-790f-4545-a574-1398fc378062 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.661557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ae8c3-790f-4545-a574-1398fc378062 None admin] RBAC: Adding query filter params (role.id=b3da02096234495595b953977e8296d3, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=eea7c50b99044720801876cce86e4311) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:16.661876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ae8c3-790f-4545-a574-1398fc378062 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:16.663417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ae8c3-790f-4545-a574-1398fc378062 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-8fdc71af-e63d-4e7b-950c-73eb28d6a286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:16.671522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:16.673299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:16.675822 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:16.675822 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:16.675822 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:16.675822 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:16.675822 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:16.675822 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:16.675822 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:16.675822 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:16.676977 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 316/636] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:16 2022] GET /identity/v3/role_assignments?user.id=eea7c50b99044720801876cce86e4311&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=b3da02096234495595b953977e8296d3 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:16.686163 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 321/637] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:16.690235 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae8c3-790f-4545-a574-1398fc378062 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:16.729346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3239e0-0fbc-481d-acee-2da5fbcddc4d None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.729669 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3239e0-0fbc-481d-acee-2da5fbcddc4d None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.729994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3239e0-0fbc-481d-acee-2da5fbcddc4d None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.731703 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 322/638] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:16.737720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226426b-654e-4e7c-af16-24ccd115ad5c None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.737984 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226426b-654e-4e7c-af16-24ccd115ad5c None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.738327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226426b-654e-4e7c-af16-24ccd115ad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.758840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-3226426b-654e-4e7c-af16-24ccd115ad5c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:16.760186 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-3226426b-654e-4e7c-af16-24ccd115ad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:16.821718 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:16.852892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 323/639] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:16.873534 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226426b-654e-4e7c-af16-24ccd115ad5c None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:16.921534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ae8c3-790f-4545-a574-1398fc378062 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:16.936902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:16.986308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf9194-4c91-4289-bc2a-2fd6d46c2c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:16.987128 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf9194-4c91-4289-bc2a-2fd6d46c2c7a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:16.987417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf9194-4c91-4289-bc2a-2fd6d46c2c7a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:16.987733 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cf9194-4c91-4289-bc2a-2fd6d46c2c7a None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:16.988553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf9194-4c91-4289-bc2a-2fd6d46c2c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:16.988867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf9194-4c91-4289-bc2a-2fd6d46c2c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:16.991570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cf9194-4c91-4289-bc2a-2fd6d46c2c7a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:17.006324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 317/640] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:17.015715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf9194-4c91-4289-bc2a-2fd6d46c2c7a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:17.038879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226426b-654e-4e7c-af16-24ccd115ad5c None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:17.098628 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5ca06-ca07-4b18-9c83-51ad00a1c2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:17.099545 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5ca06-ca07-4b18-9c83-51ad00a1c2e8 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.100391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5ca06-ca07-4b18-9c83-51ad00a1c2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.100884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5ca06-ca07-4b18-9c83-51ad00a1c2e8 None admin] PATH_INFO: `/v3/services/image` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.101914 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5ca06-ca07-4b18-9c83-51ad00a1c2e8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:17.103948 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5ca06-ca07-4b18-9c83-51ad00a1c2e8 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-4aa5ca06-ca07-4b18-9c83-51ad00a1c2e8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:17.123603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:17.125578 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:17.128630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 324/641] 10.222.0.24 () {56 vars in 1105 bytes} [Sat Jun 4 20:36:16 2022] GET /identity/v3/services/image => generated 86 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:17.131851 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5ca06-ca07-4b18-9c83-51ad00a1c2e8 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:17.168160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cf9194-4c91-4289-bc2a-2fd6d46c2c7a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:17.192743 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:17.210394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bd9e7-8980-42ac-a45b-e34da8401184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:17.211285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bd9e7-8980-42ac-a45b-e34da8401184 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.211650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bd9e7-8980-42ac-a45b-e34da8401184 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.211980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331bd9e7-8980-42ac-a45b-e34da8401184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.212936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bd9e7-8980-42ac-a45b-e34da8401184 None admin] RBAC: Adding query filter params (role.id=b3da02096234495595b953977e8296d3, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=75a7632fe5b5474ab6afd5b3d1bee4e6) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:17.213320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bd9e7-8980-42ac-a45b-e34da8401184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:17.215080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331bd9e7-8980-42ac-a45b-e34da8401184 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:17.222570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 318/642] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:17 2022] GET /identity/v3/role_assignments?user.id=75a7632fe5b5474ab6afd5b3d1bee4e6&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=b3da02096234495595b953977e8296d3 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:17.259178 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5ca06-ca07-4b18-9c83-51ad00a1c2e8 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:17.303176 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25ddb58-0f0d-4297-84ad-3a7f7d8568a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:17.304622 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ddb58-0f0d-4297-84ad-3a7f7d8568a7 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.305131 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ddb58-0f0d-4297-84ad-3a7f7d8568a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.305591 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ddb58-0f0d-4297-84ad-3a7f7d8568a7 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.306541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ddb58-0f0d-4297-84ad-3a7f7d8568a7 None admin] RBAC: Adding query filter params (name=image) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:17.307111 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ddb58-0f0d-4297-84ad-3a7f7d8568a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:17.308856 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25ddb58-0f0d-4297-84ad-3a7f7d8568a7 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:17.315701 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 325/643] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:17 2022] GET /identity/v3/services?name=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:17.324519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bd9e7-8980-42ac-a45b-e34da8401184 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:17.361705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:17.466151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331bd9e7-8980-42ac-a45b-e34da8401184 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:17.511351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b4623-e209-4d9b-86ac-c5f2f7d402c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:17.511951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b4623-e209-4d9b-86ac-c5f2f7d402c5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.512237 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b4623-e209-4d9b-86ac-c5f2f7d402c5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.512549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b4623-e209-4d9b-86ac-c5f2f7d402c5 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.513301 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b4623-e209-4d9b-86ac-c5f2f7d402c5 None admin] RBAC: Adding query filter params (type=image) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:17.513602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b4623-e209-4d9b-86ac-c5f2f7d402c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:17.515413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b4623-e209-4d9b-86ac-c5f2f7d402c5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:17.523560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 319/644] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:17 2022] GET /identity/v3/services?type=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:17.823195 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375d1bb-12a3-4b9a-93b3-2013c03aaed7 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.823718 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375d1bb-12a3-4b9a-93b3-2013c03aaed7 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.824110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e375d1bb-12a3-4b9a-93b3-2013c03aaed7 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.827122 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 326/645] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:17.836354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b058ee-b29f-469a-b61c-c9f1353fd67d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:17.836871 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b058ee-b29f-469a-b61c-c9f1353fd67d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:17.837349 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b058ee-b29f-469a-b61c-c9f1353fd67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:17.868699 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-29b058ee-b29f-469a-b61c-c9f1353fd67d None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:17.870778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-29b058ee-b29f-469a-b61c-c9f1353fd67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:17.977776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 320/646] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:18.002256 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375d1bb-12a3-4b9a-93b3-2013c03aaed7 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:18.128464 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e375d1bb-12a3-4b9a-93b3-2013c03aaed7 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:18.157024 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:18.169547 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8997dfd-d515-426a-8420-eff3dc89ce7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:18.170166 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8997dfd-d515-426a-8420-eff3dc89ce7c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:18.170436 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8997dfd-d515-426a-8420-eff3dc89ce7c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:18.171083 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8997dfd-d515-426a-8420-eff3dc89ce7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:18.185769 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8997dfd-d515-426a-8420-eff3dc89ce7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-b8997dfd-d515-426a-8420-eff3dc89ce7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:18.195097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:18.196971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:18.198720 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 327/647] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:18.202802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b058ee-b29f-469a-b61c-c9f1353fd67d None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:18.237655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:18.396633 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b058ee-b29f-469a-b61c-c9f1353fd67d None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:18.464372 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2936b-8a13-4f2e-9741-558bbe1180ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:18.465426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2936b-8a13-4f2e-9741-558bbe1180ed None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:18.465876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2936b-8a13-4f2e-9741-558bbe1180ed None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:18.466319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe2936b-8a13-4f2e-9741-558bbe1180ed None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:18.467542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2936b-8a13-4f2e-9741-558bbe1180ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:18.468039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2936b-8a13-4f2e-9741-558bbe1180ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:18.470357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe2936b-8a13-4f2e-9741-558bbe1180ed None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:18.487391 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 321/648] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:18.493507 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8997dfd-d515-426a-8420-eff3dc89ce7c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:18.627982 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8997dfd-d515-426a-8420-eff3dc89ce7c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:18.667857 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9aa23a-a285-4570-bdc4-e8e1a3a0173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:18.669089 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aa23a-a285-4570-bdc4-e8e1a3a0173d None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:18.669616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aa23a-a285-4570-bdc4-e8e1a3a0173d None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:18.670083 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9aa23a-a285-4570-bdc4-e8e1a3a0173d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:18.683329 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9aa23a-a285-4570-bdc4-e8e1a3a0173d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:18.685390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9aa23a-a285-4570-bdc4-e8e1a3a0173d None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-fc9aa23a-a285-4570-bdc4-e8e1a3a0173d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:18.705031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:18.705994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:18.706919 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:18.706919 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:18.706919 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:18.706919 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:18.709587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 328/649] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:18.715554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2936b-8a13-4f2e-9741-558bbe1180ed None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:18.823959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:18.855678 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe2936b-8a13-4f2e-9741-558bbe1180ed None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:18.923608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bd88b-e11f-4ddb-a902-75172a6ec942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:18.924696 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bd88b-e11f-4ddb-a902-75172a6ec942 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:18.925185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bd88b-e11f-4ddb-a902-75172a6ec942 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:18.925638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7bd88b-e11f-4ddb-a902-75172a6ec942 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:18.926967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bd88b-e11f-4ddb-a902-75172a6ec942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:18.927510 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bd88b-e11f-4ddb-a902-75172a6ec942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:18.930409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7bd88b-e11f-4ddb-a902-75172a6ec942 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:18.955184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 322/650] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:18.964694 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9aa23a-a285-4570-bdc4-e8e1a3a0173d None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:19.019564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:19.171257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9aa23a-a285-4570-bdc4-e8e1a3a0173d None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:19.237905 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a67ef-d319-4e78-808f-bf2b74f04ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:19.239270 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a67ef-d319-4e78-808f-bf2b74f04ee8 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.239770 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a67ef-d319-4e78-808f-bf2b74f04ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.240233 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a67ef-d319-4e78-808f-bf2b74f04ee8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:19.256683 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a67ef-d319-4e78-808f-bf2b74f04ee8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:19.259467 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a67ef-d319-4e78-808f-bf2b74f04ee8 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-292a67ef-d319-4e78-808f-bf2b74f04ee8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:19.288898 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:19.290754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:19.292674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:19.292674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:19.292674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:19.292674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:19.292674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:19.292674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:19.292674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:19.292674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:19.292674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:19.292674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:19.292674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 329/651] 10.222.0.24 () {56 vars in 1093 bytes} [Sat Jun 4 20:36:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:19.301283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bd88b-e11f-4ddb-a902-75172a6ec942 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:19.517511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7bd88b-e11f-4ddb-a902-75172a6ec942 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:19.589241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0252850-7b51-4a01-95f3-13e3e174db00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:19.590366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252850-7b51-4a01-95f3-13e3e174db00 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.590847 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252850-7b51-4a01-95f3-13e3e174db00 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.591314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0252850-7b51-4a01-95f3-13e3e174db00 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:19.592896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0252850-7b51-4a01-95f3-13e3e174db00 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:19.593433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0252850-7b51-4a01-95f3-13e3e174db00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:19.596127 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0252850-7b51-4a01-95f3-13e3e174db00 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:19.635040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 323/652] 10.222.0.24 () {56 vars in 1133 bytes} [Sat Jun 4 20:36:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:19.644183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a67ef-d319-4e78-808f-bf2b74f04ee8 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:19.816296 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:19.846456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a67ef-d319-4e78-808f-bf2b74f04ee8 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:19.913348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6c0bb-2e00-4ef1-846f-ef3b6a16a991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:19.914472 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6c0bb-2e00-4ef1-846f-ef3b6a16a991 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:19.914963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6c0bb-2e00-4ef1-846f-ef3b6a16a991 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:19.915447 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6c0bb-2e00-4ef1-846f-ef3b6a16a991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:20.033090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de445d9-8dd9-413f-9fd3-c661a3f104ed None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:20.033655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de445d9-8dd9-413f-9fd3-c661a3f104ed None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:20.034014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de445d9-8dd9-413f-9fd3-c661a3f104ed None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:20.045318 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 324/653] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:20 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:20.047936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e8632-9c85-47b0-9a89-835603f974e6 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:20.048412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e8632-9c85-47b0-9a89-835603f974e6 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:20.048934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e8632-9c85-47b0-9a89-835603f974e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:20.059778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:20.073263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6c0bb-2e00-4ef1-846f-ef3b6a16a991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:20.075903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6c0bb-2e00-4ef1-846f-ef3b6a16a991 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:20.094778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a74e8632-9c85-47b0-9a89-835603f974e6 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:20.099297 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a74e8632-9c85-47b0-9a89-835603f974e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:20.261247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 325/654] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:20.288600 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:20.302938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e8632-9c85-47b0-9a89-835603f974e6 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:20.327931 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 330/655] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 04 20:36:20.339335 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6c0bb-2e00-4ef1-846f-ef3b6a16a991 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:20.483769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e8632-9c85-47b0-9a89-835603f974e6 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:20.524736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:20.534451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6620678-c148-47d4-a6a4-fef5769c9654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:20.535877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6620678-c148-47d4-a6a4-fef5769c9654 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:20.536380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6620678-c148-47d4-a6a4-fef5769c9654 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:20.536891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6620678-c148-47d4-a6a4-fef5769c9654 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:20.538159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6620678-c148-47d4-a6a4-fef5769c9654 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:20.540783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6620678-c148-47d4-a6a4-fef5769c9654 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:20.547310 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6c0bb-2e00-4ef1-846f-ef3b6a16a991 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-f6620678-c148-47d4-a6a4-fef5769c9654 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:20.569421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:20.571292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:20.573050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 326/656] 10.222.0.24 () {56 vars in 1129 bytes} [Sat Jun 4 20:36:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:20.576221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f9cf-5701-433d-b2b0-b20304f599f2 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:20.576221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f9cf-5701-433d-b2b0-b20304f599f2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:20.576221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e1f9cf-5701-433d-b2b0-b20304f599f2 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:20.579201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 327/657] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:20.580660 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1f9cf-5701-433d-b2b0-b20304f599f2 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:20.620872 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e83823-41e2-40b5-806e-e03fb58ab0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:20.621719 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83823-41e2-40b5-806e-e03fb58ab0c1 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:20.622005 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83823-41e2-40b5-806e-e03fb58ab0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:20.622289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e83823-41e2-40b5-806e-e03fb58ab0c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:20.636595 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e83823-41e2-40b5-806e-e03fb58ab0c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:20.638130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e83823-41e2-40b5-806e-e03fb58ab0c1 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-84e83823-41e2-40b5-806e-e03fb58ab0c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:20.659909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:20.661580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:20.663318 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:20.663318 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:20.663318 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:20.663318 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:20.663318 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 331/658] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:20.663318 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4e96f-f97d-4cf2-a52f-d7048036b547 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:20.663318 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4e96f-f97d-4cf2-a52f-d7048036b547 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:20.664040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4e96f-f97d-4cf2-a52f-d7048036b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:20.683852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-79f4e96f-f97d-4cf2-a52f-d7048036b547 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:20.685259 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-79f4e96f-f97d-4cf2-a52f-d7048036b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:20.728966 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:20.790149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e1f9cf-5701-433d-b2b0-b20304f599f2 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:20.804469 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 332/659] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:20.804469 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4e96f-f97d-4cf2-a52f-d7048036b547 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:20.858187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903874-3df1-4e29-8682-a819b53430b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:20.859115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903874-3df1-4e29-8682-a819b53430b3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:20.859502 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903874-3df1-4e29-8682-a819b53430b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:20.859878 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20903874-3df1-4e29-8682-a819b53430b3 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:20.860985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20903874-3df1-4e29-8682-a819b53430b3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:20.861632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20903874-3df1-4e29-8682-a819b53430b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:20.864372 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20903874-3df1-4e29-8682-a819b53430b3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:20.880393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 328/660] 10.222.0.24 () {56 vars in 1124 bytes} [Sat Jun 4 20:36:20 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:20.880393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903874-3df1-4e29-8682-a819b53430b3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:20.957524 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4e96f-f97d-4cf2-a52f-d7048036b547 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:20.994886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:21.003860 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f743d7e-862f-46af-92aa-9afeed591281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:21.004685 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743d7e-862f-46af-92aa-9afeed591281 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.005055 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743d7e-862f-46af-92aa-9afeed591281 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.005270 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f743d7e-862f-46af-92aa-9afeed591281 None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.005986 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f743d7e-862f-46af-92aa-9afeed591281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:21.006385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f743d7e-862f-46af-92aa-9afeed591281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:21.007987 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f743d7e-862f-46af-92aa-9afeed591281 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:21.028492 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 333/661] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:21.028492 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f743d7e-862f-46af-92aa-9afeed591281 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:21.070324 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:21.071633 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20903874-3df1-4e29-8682-a819b53430b3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:21.124899 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81089df6-dd96-495f-ad79-f820894652a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:21.125586 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81089df6-dd96-495f-ad79-f820894652a8 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.126000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81089df6-dd96-495f-ad79-f820894652a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.126343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81089df6-dd96-495f-ad79-f820894652a8 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.127157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81089df6-dd96-495f-ad79-f820894652a8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:21.128686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81089df6-dd96-495f-ad79-f820894652a8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:21.152120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 329/662] 10.222.0.24 () {60 vars in 1141 bytes} [Sat Jun 4 20:36:20 2022] POST /identity/v3/services => generated 242 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:21.153558 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81089df6-dd96-495f-ad79-f820894652a8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:21.176831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f743d7e-862f-46af-92aa-9afeed591281 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:21.263868 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c5443-efc2-42fc-8891-583aca489a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:21.265266 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5443-efc2-42fc-8891-583aca489a58 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.265685 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5443-efc2-42fc-8891-583aca489a58 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.266100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c5443-efc2-42fc-8891-583aca489a58 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.267215 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5443-efc2-42fc-8891-583aca489a58 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:21.267750 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5443-efc2-42fc-8891-583aca489a58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:21.270056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c5443-efc2-42fc-8891-583aca489a58 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:21.286333 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 334/663] 10.222.0.24 () {56 vars in 1124 bytes} [Sat Jun 4 20:36:21 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:21.286333 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7812b-53ca-4f3a-88d0-30f62c930c92 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.286333 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7812b-53ca-4f3a-88d0-30f62c930c92 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.286333 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7812b-53ca-4f3a-88d0-30f62c930c92 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.286333 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 335/664] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:21.295581 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e8168-efd9-4ac6-80ae-ee4f13753293 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.296513 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e8168-efd9-4ac6-80ae-ee4f13753293 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.296622 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e8168-efd9-4ac6-80ae-ee4f13753293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.338380 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-c82e8168-efd9-4ac6-80ae-ee4f13753293 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:21.344813 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-c82e8168-efd9-4ac6-80ae-ee4f13753293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:21.348508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81089df6-dd96-495f-ad79-f820894652a8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:21.420301 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:21.474323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be357ef-7d68-453f-b6f5-2b842b39d50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:21.479225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be357ef-7d68-453f-b6f5-2b842b39d50d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.479764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be357ef-7d68-453f-b6f5-2b842b39d50d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.480239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be357ef-7d68-453f-b6f5-2b842b39d50d None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.503271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be357ef-7d68-453f-b6f5-2b842b39d50d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:21.508377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be357ef-7d68-453f-b6f5-2b842b39d50d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-0be357ef-7d68-453f-b6f5-2b842b39d50d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:21.550762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:21.552635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:21.555037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:21.555037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:21.555037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:21.555037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:21.555037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:21.555037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:21.555037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:21.555037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:21.555037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 330/665] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:21.563243 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be357ef-7d68-453f-b6f5-2b842b39d50d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:21.603945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 336/666] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:21 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:21.630034 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e8168-efd9-4ac6-80ae-ee4f13753293 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:21.683754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:21.818088 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be357ef-7d68-453f-b6f5-2b842b39d50d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:21.901796 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184c4de-8813-446e-be3c-6a5122622148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:21.903130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184c4de-8813-446e-be3c-6a5122622148 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:21.903718 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184c4de-8813-446e-be3c-6a5122622148 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:21.904299 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c184c4de-8813-446e-be3c-6a5122622148 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:21.906316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184c4de-8813-446e-be3c-6a5122622148 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:21.906969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184c4de-8813-446e-be3c-6a5122622148 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:21.910192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c184c4de-8813-446e-be3c-6a5122622148 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:21.939925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 331/667] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:21.947116 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e8168-efd9-4ac6-80ae-ee4f13753293 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:21.951470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184c4de-8813-446e-be3c-6a5122622148 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:22.056019 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5dbc1-76f1-4d0e-a9b6-dee44ebbce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:22.056346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:22.059457 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5dbc1-76f1-4d0e-a9b6-dee44ebbce45 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:22.059457 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5dbc1-76f1-4d0e-a9b6-dee44ebbce45 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:22.059457 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5dbc1-76f1-4d0e-a9b6-dee44ebbce45 None admin] PATH_INFO: `/v3/services/network` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:22.061435 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5dbc1-76f1-4d0e-a9b6-dee44ebbce45 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:22.071072 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5dbc1-76f1-4d0e-a9b6-dee44ebbce45 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-3aa5dbc1-76f1-4d0e-a9b6-dee44ebbce45 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:22.124265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:22.126048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:36:22.128147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:22.140154 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 337/668] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:21 2022] GET /identity/v3/services/network => generated 88 bytes in 509 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:22.149513 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5dbc1-76f1-4d0e-a9b6-dee44ebbce45 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:22.239662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c184c4de-8813-446e-be3c-6a5122622148 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:22.320686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18b576-638b-429e-b3b9-7b59275451ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:22.322287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18b576-638b-429e-b3b9-7b59275451ed None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:22.322774 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18b576-638b-429e-b3b9-7b59275451ed None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:22.323301 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18b576-638b-429e-b3b9-7b59275451ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:22.326505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18b576-638b-429e-b3b9-7b59275451ed None admin] RBAC: Adding query filter params (role.id=f315b062be7e445fa9461a116f9c46ee, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=b82d01982ea7412aa396b517ed80bd4c) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:22.327062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18b576-638b-429e-b3b9-7b59275451ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:22.329865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18b576-638b-429e-b3b9-7b59275451ed None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:22.348779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 332/669] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:21 2022] GET /identity/v3/role_assignments?user.id=b82d01982ea7412aa396b517ed80bd4c&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=f315b062be7e445fa9461a116f9c46ee => generated 259 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:22.373483 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:22.396311 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5dbc1-76f1-4d0e-a9b6-dee44ebbce45 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:22.466951 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623442b5-1d3f-4db0-a453-a65645accf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:22.468554 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623442b5-1d3f-4db0-a453-a65645accf40 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:22.469315 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623442b5-1d3f-4db0-a453-a65645accf40 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:22.470020 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623442b5-1d3f-4db0-a453-a65645accf40 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:22.471634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623442b5-1d3f-4db0-a453-a65645accf40 None admin] RBAC: Adding query filter params (name=network) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:22.472396 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623442b5-1d3f-4db0-a453-a65645accf40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:22.475353 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623442b5-1d3f-4db0-a453-a65645accf40 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:22.485444 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 338/670] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:36:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:22.495059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18b576-638b-429e-b3b9-7b59275451ed None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:22.718921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18b576-638b-429e-b3b9-7b59275451ed None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:22.723879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:22.763104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b1321f-35b0-4f67-85a8-af450d1f3e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:22.763697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1321f-35b0-4f67-85a8-af450d1f3e47 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:22.763992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1321f-35b0-4f67-85a8-af450d1f3e47 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:22.764606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b1321f-35b0-4f67-85a8-af450d1f3e47 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:22.765356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1321f-35b0-4f67-85a8-af450d1f3e47 None admin] RBAC: Adding query filter params (type=network) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:22.765663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1321f-35b0-4f67-85a8-af450d1f3e47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:22.767090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b1321f-35b0-4f67-85a8-af450d1f3e47 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:22.773617 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 333/671] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:36:22 2022] GET /identity/v3/services?type=network => generated 124 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:24.109658 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a535-0763-4d5b-bd41-7576a459f145 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.110203 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a535-0763-4d5b-bd41-7576a459f145 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.110620 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f3a535-0763-4d5b-bd41-7576a459f145 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.113369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 339/672] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:24.122902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220e1d-3900-48a2-8070-4f2986f0494d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.123466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220e1d-3900-48a2-8070-4f2986f0494d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.123858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b220e1d-3900-48a2-8070-4f2986f0494d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.151768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-5b220e1d-3900-48a2-8070-4f2986f0494d None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:24.153646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-5b220e1d-3900-48a2-8070-4f2986f0494d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:24.228926 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee26fcb-2245-42d3-851d-b7ab9b297b8a None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.229291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee26fcb-2245-42d3-851d-b7ab9b297b8a None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.229525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee26fcb-2245-42d3-851d-b7ab9b297b8a None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.230969 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 340/673] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:24.237218 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75a7fd-e8c3-471c-9052-0f6017a0a8d8 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.237679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75a7fd-e8c3-471c-9052-0f6017a0a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.238066 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75a7fd-e8c3-471c-9052-0f6017a0a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.256763 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-cb75a7fd-e8c3-471c-9052-0f6017a0a8d8 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:24.258040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-cb75a7fd-e8c3-471c-9052-0f6017a0a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:24.278223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 334/674] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:24 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:24.301785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b220e1d-3900-48a2-8070-4f2986f0494d None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:24.357349 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 341/675] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:24 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:24.382146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75a7fd-e8c3-471c-9052-0f6017a0a8d8 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:24.439242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:24.444454 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b220e1d-3900-48a2-8070-4f2986f0494d None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:24.484113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd755-2025-4f9f-9cde-dd5872a6a106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:24.485257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd755-2025-4f9f-9cde-dd5872a6a106 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.485753 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd755-2025-4f9f-9cde-dd5872a6a106 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.486232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271cd755-2025-4f9f-9cde-dd5872a6a106 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.487227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cd755-2025-4f9f-9cde-dd5872a6a106 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:24.488949 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271cd755-2025-4f9f-9cde-dd5872a6a106 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:24.495346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:24.505157 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75a7fd-e8c3-471c-9052-0f6017a0a8d8 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:24.509034 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 335/676] 10.222.0.24 () {60 vars in 1141 bytes} [Sat Jun 4 20:36:24 2022] POST /identity/v3/services => generated 251 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:36:24.559728 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f287f-368e-4af6-b702-0c643aaf5685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:24.560609 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f287f-368e-4af6-b702-0c643aaf5685 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.560897 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f287f-368e-4af6-b702-0c643aaf5685 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.561181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052f287f-368e-4af6-b702-0c643aaf5685 None admin] PATH_INFO: `/v3/services/image` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.561858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f287f-368e-4af6-b702-0c643aaf5685 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:24.563354 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052f287f-368e-4af6-b702-0c643aaf5685 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-052f287f-368e-4af6-b702-0c643aaf5685 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:24.577153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:24.578274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:24.579501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 342/677] 10.222.0.24 () {56 vars in 1105 bytes} [Sat Jun 4 20:36:24 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:24.587944 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd755-2025-4f9f-9cde-dd5872a6a106 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:24.718138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271cd755-2025-4f9f-9cde-dd5872a6a106 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:24.763479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aaf00-0840-4778-87c5-869b28ee0794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:24.764994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aaf00-0840-4778-87c5-869b28ee0794 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.765527 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aaf00-0840-4778-87c5-869b28ee0794 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.766009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6aaf00-0840-4778-87c5-869b28ee0794 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.767054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aaf00-0840-4778-87c5-869b28ee0794 None admin] RBAC: Adding query filter params (name=image) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:24.767638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aaf00-0840-4778-87c5-869b28ee0794 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:24.769432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6aaf00-0840-4778-87c5-869b28ee0794 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:24.780580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 336/678] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:24.782393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f287f-368e-4af6-b702-0c643aaf5685 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:24.935478 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052f287f-368e-4af6-b702-0c643aaf5685 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:24.980151 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a509a7-a937-41d8-b598-f3d931c8f38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:24.980814 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a509a7-a937-41d8-b598-f3d931c8f38c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:24.981098 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a509a7-a937-41d8-b598-f3d931c8f38c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:24.981377 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a509a7-a937-41d8-b598-f3d931c8f38c None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:24.982129 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a509a7-a937-41d8-b598-f3d931c8f38c None admin] RBAC: Adding query filter params (type=image) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:24.982440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a509a7-a937-41d8-b598-f3d931c8f38c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:24.983976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a509a7-a937-41d8-b598-f3d931c8f38c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:24.985793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:24.991234 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 343/679] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:25.001192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aaf00-0840-4778-87c5-869b28ee0794 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.049267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:25.173284 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b73e2-650a-4656-9eb4-1aa9bf433c6e None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.174459 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b73e2-650a-4656-9eb4-1aa9bf433c6e None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.174962 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b73e2-650a-4656-9eb4-1aa9bf433c6e None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.177065 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 344/680] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:25.183692 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0a1db-9dd1-4099-bb6d-11c794b01d0b None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.184356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0a1db-9dd1-4099-bb6d-11c794b01d0b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.184860 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0a1db-9dd1-4099-bb6d-11c794b01d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.193845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6aaf00-0840-4778-87c5-869b28ee0794 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.205257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-e4f0a1db-9dd1-4099-bb6d-11c794b01d0b None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:25.206851 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-e4f0a1db-9dd1-4099-bb6d-11c794b01d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:25.248298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a81744-19c7-476f-95b1-953135ad93ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.249473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a81744-19c7-476f-95b1-953135ad93ae None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.249978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a81744-19c7-476f-95b1-953135ad93ae None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.250413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a81744-19c7-476f-95b1-953135ad93ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.252686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a81744-19c7-476f-95b1-953135ad93ae None admin] RBAC: Adding query filter params (interface=public, service_id=d14adfa9fbfa4434a9ee6c65ecfb69cf, region_id=RegionOne) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:25.252821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a81744-19c7-476f-95b1-953135ad93ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:25.255446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a81744-19c7-476f-95b1-953135ad93ae None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:25.268008 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 337/681] 10.222.0.24 () {56 vars in 1251 bytes} [Sat Jun 4 20:36:24 2022] GET /identity/v3/endpoints?service_id=d14adfa9fbfa4434a9ee6c65ecfb69cf&interface=public®ion_id=RegionOne => generated 194 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:25.277035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a81744-19c7-476f-95b1-953135ad93ae None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.296556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 345/682] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:25 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 04 20:36:25.311377 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf456-774d-45b2-b9a7-75e3219c9489 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.311666 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf456-774d-45b2-b9a7-75e3219c9489 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.312037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf456-774d-45b2-b9a7-75e3219c9489 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.313956 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 346/683] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:25.321084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bf456-774d-45b2-b9a7-75e3219c9489 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.408843 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:25.421981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a81744-19c7-476f-95b1-953135ad93ae None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.448260 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bf456-774d-45b2-b9a7-75e3219c9489 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.465831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65040dd0-1680-435a-aec3-9497a550b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.466620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65040dd0-1680-435a-aec3-9497a550b039 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.466917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65040dd0-1680-435a-aec3-9497a550b039 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.467189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65040dd0-1680-435a-aec3-9497a550b039 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.467890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65040dd0-1680-435a-aec3-9497a550b039 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:25.469354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65040dd0-1680-435a-aec3-9497a550b039 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:25.475644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 338/684] 10.222.0.24 () {56 vars in 1087 bytes} [Sat Jun 4 20:36:25 2022] GET /identity/v3/services => generated 774 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:25.477576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3f1ad-4df4-45a8-9b93-61cfa5fe4164 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.477874 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3f1ad-4df4-45a8-9b93-61cfa5fe4164 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.478157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3f1ad-4df4-45a8-9b93-61cfa5fe4164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.485746 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:25.498896 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095ba13-99bc-44dc-a4cb-e72bc6818c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.500787 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095ba13-99bc-44dc-a4cb-e72bc6818c5f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.501676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095ba13-99bc-44dc-a4cb-e72bc6818c5f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.502419 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095ba13-99bc-44dc-a4cb-e72bc6818c5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.508898 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-abc3f1ad-4df4-45a8-9b93-61cfa5fe4164 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:25.510210 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-abc3f1ad-4df4-45a8-9b93-61cfa5fe4164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:25.525250 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095ba13-99bc-44dc-a4cb-e72bc6818c5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-e095ba13-99bc-44dc-a4cb-e72bc6818c5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:25.535441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:25.536632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:25.537515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:25.540934 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 347/685] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:36:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:25.543793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095ba13-99bc-44dc-a4cb-e72bc6818c5f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.631248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 339/686] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:25 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 04 20:36:25.650804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3f1ad-4df4-45a8-9b93-61cfa5fe4164 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.697388 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095ba13-99bc-44dc-a4cb-e72bc6818c5f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.756144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c801-4a01-4f0c-b2e3-fe1e991e1352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.757535 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:25.758136 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c801-4a01-4f0c-b2e3-fe1e991e1352 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.759635 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c801-4a01-4f0c-b2e3-fe1e991e1352 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.760198 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5c801-4a01-4f0c-b2e3-fe1e991e1352 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.761745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c801-4a01-4f0c-b2e3-fe1e991e1352 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:25.762338 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c801-4a01-4f0c-b2e3-fe1e991e1352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:25.765176 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a5c801-4a01-4f0c-b2e3-fe1e991e1352 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:25.779175 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 348/687] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:25.785583 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c801-4a01-4f0c-b2e3-fe1e991e1352 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:25.787712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc3f1ad-4df4-45a8-9b93-61cfa5fe4164 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.836422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c8b10-06c9-454b-a524-5570a1a03d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.837827 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c8b10-06c9-454b-a524-5570a1a03d64 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.838468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c8b10-06c9-454b-a524-5570a1a03d64 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.838971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6c8b10-06c9-454b-a524-5570a1a03d64 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:25.840521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c8b10-06c9-454b-a524-5570a1a03d64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:25.844466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6c8b10-06c9-454b-a524-5570a1a03d64 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:25.866108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:25.878478 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 340/688] 10.222.0.24 () {60 vars in 1141 bytes} [Sat Jun 4 20:36:25 2022] POST /identity/v3/services => generated 240 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:36:25.936826 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5c801-4a01-4f0c-b2e3-fe1e991e1352 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:25.992400 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea0c1c-d8b8-4ca3-b767-bb33e988bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:25.993562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea0c1c-d8b8-4ca3-b767-bb33e988bd84 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:25.994003 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea0c1c-d8b8-4ca3-b767-bb33e988bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:25.994457 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea0c1c-d8b8-4ca3-b767-bb33e988bd84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:26.011415 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea0c1c-d8b8-4ca3-b767-bb33e988bd84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:26.013259 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea0c1c-d8b8-4ca3-b767-bb33e988bd84 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-56ea0c1c-d8b8-4ca3-b767-bb33e988bd84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:26.036774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:26.037999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:26.039247 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:26.039247 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:26.039247 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:26.039247 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:26.041323 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 349/689] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:26.048322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c8b10-06c9-454b-a524-5570a1a03d64 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:26.226548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6c8b10-06c9-454b-a524-5570a1a03d64 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:26.272270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe23835-f08f-408b-ba86-c8d1ca60141e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:26.273149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23835-f08f-408b-ba86-c8d1ca60141e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:26.273435 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23835-f08f-408b-ba86-c8d1ca60141e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:26.273720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe23835-f08f-408b-ba86-c8d1ca60141e None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:26.274475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe23835-f08f-408b-ba86-c8d1ca60141e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:26.274786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe23835-f08f-408b-ba86-c8d1ca60141e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:26.276211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe23835-f08f-408b-ba86-c8d1ca60141e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:26.286427 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:26.290820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 341/690] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:26.301307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea0c1c-d8b8-4ca3-b767-bb33e988bd84 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:26.489408 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:26.496426 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea0c1c-d8b8-4ca3-b767-bb33e988bd84 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:26.565232 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234ca6-9ff4-44ef-a6ba-a42756539d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:26.566722 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234ca6-9ff4-44ef-a6ba-a42756539d10 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:26.567221 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234ca6-9ff4-44ef-a6ba-a42756539d10 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:26.567713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94234ca6-9ff4-44ef-a6ba-a42756539d10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:26.584526 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234ca6-9ff4-44ef-a6ba-a42756539d10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:26.587276 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94234ca6-9ff4-44ef-a6ba-a42756539d10 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-94234ca6-9ff4-44ef-a6ba-a42756539d10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:26.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:26.618979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:26.622108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:26.622108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:26.622108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:26.622108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:26.622108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:26.622108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:26.622108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:26.622108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:26.622108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:26.622108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:26.622108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 350/691] 10.222.0.24 () {56 vars in 1093 bytes} [Sat Jun 4 20:36:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:26.629133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe23835-f08f-408b-ba86-c8d1ca60141e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:26.751633 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe23835-f08f-408b-ba86-c8d1ca60141e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:26.791816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f5b0d-a1a2-416e-b290-f6ce22074c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:26.792425 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f5b0d-a1a2-416e-b290-f6ce22074c8e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:26.792717 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f5b0d-a1a2-416e-b290-f6ce22074c8e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:26.793002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5f5b0d-a1a2-416e-b290-f6ce22074c8e None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:26.793885 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f5b0d-a1a2-416e-b290-f6ce22074c8e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:26.794223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f5b0d-a1a2-416e-b290-f6ce22074c8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:26.795699 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5f5b0d-a1a2-416e-b290-f6ce22074c8e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:26.816696 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 342/692] 10.222.0.24 () {56 vars in 1133 bytes} [Sat Jun 4 20:36:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:26.825197 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234ca6-9ff4-44ef-a6ba-a42756539d10 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:26.948283 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94234ca6-9ff4-44ef-a6ba-a42756539d10 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:26.984808 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7680576-2f44-4a48-9be7-f51addcff1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:26.985625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7680576-2f44-4a48-9be7-f51addcff1b0 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:26.985913 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7680576-2f44-4a48-9be7-f51addcff1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:26.986193 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7680576-2f44-4a48-9be7-f51addcff1b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:26.998121 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7680576-2f44-4a48-9be7-f51addcff1b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:26.999601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7680576-2f44-4a48-9be7-f51addcff1b0 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-b7680576-2f44-4a48-9be7-f51addcff1b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:27.019752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:27.022062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:27.023973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:27.023973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:27.023973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:27.023973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:27.023973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 351/693] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:27.029614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f5b0d-a1a2-416e-b290-f6ce22074c8e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:27.092944 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:27.138286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5f5b0d-a1a2-416e-b290-f6ce22074c8e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:27.174985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b735e2-91f2-4f00-a047-d1296b622505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:27.175668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b735e2-91f2-4f00-a047-d1296b622505 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:27.175951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b735e2-91f2-4f00-a047-d1296b622505 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:27.176229 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b735e2-91f2-4f00-a047-d1296b622505 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:27.176993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b735e2-91f2-4f00-a047-d1296b622505 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:27.177298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b735e2-91f2-4f00-a047-d1296b622505 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:27.178783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b735e2-91f2-4f00-a047-d1296b622505 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:27.191761 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 343/694] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:27.197832 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7680576-2f44-4a48-9be7-f51addcff1b0 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:27.218163 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:27.316539 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7680576-2f44-4a48-9be7-f51addcff1b0 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:27.353913 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527ea97-74f1-46df-9490-78221e99e55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:27.354629 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527ea97-74f1-46df-9490-78221e99e55f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:27.354909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527ea97-74f1-46df-9490-78221e99e55f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:27.355169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527ea97-74f1-46df-9490-78221e99e55f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:27.362928 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527ea97-74f1-46df-9490-78221e99e55f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:27.364423 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527ea97-74f1-46df-9490-78221e99e55f None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-a527ea97-74f1-46df-9490-78221e99e55f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:27.379830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:27.382893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:27.385141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:27.385141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:27.385141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:27.385141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:27.385141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:27.385141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:27.385141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:27.385141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:27.385141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 352/695] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:27.390855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b735e2-91f2-4f00-a047-d1296b622505 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:27.460762 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26537f-bf9b-414d-b341-2a1295e684bb None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:27.461231 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26537f-bf9b-414d-b341-2a1295e684bb None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:27.461702 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26537f-bf9b-414d-b341-2a1295e684bb None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:27.464581 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 353/696] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:27.473539 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859330b9-12c9-4906-8387-27806775e378 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:27.474025 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859330b9-12c9-4906-8387-27806775e378 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:27.474504 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859330b9-12c9-4906-8387-27806775e378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:27.502060 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-859330b9-12c9-4906-8387-27806775e378 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:27.504048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-859330b9-12c9-4906-8387-27806775e378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:27.572810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b735e2-91f2-4f00-a047-d1296b622505 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:27.609981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:27.624063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:27.633821 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 354/697] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:27 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:36:27.644165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed4aa9-1bae-4793-bf75-b990ddcdb406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:27.644165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4aa9-1bae-4793-bf75-b990ddcdb406 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:27.644165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4aa9-1bae-4793-bf75-b990ddcdb406 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:27.644165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed4aa9-1bae-4793-bf75-b990ddcdb406 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:27.644650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed4aa9-1bae-4793-bf75-b990ddcdb406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:27.644650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed4aa9-1bae-4793-bf75-b990ddcdb406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:27.644650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed4aa9-1bae-4793-bf75-b990ddcdb406 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:27.657738 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859330b9-12c9-4906-8387-27806775e378 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:27.660254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 344/698] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:27.669113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed4aa9-1bae-4793-bf75-b990ddcdb406 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:27.827435 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859330b9-12c9-4906-8387-27806775e378 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:27.834690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed4aa9-1bae-4793-bf75-b990ddcdb406 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:27.879907 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9d1fa-1121-4d79-8de0-0b3439bf3839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:27.881601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9d1fa-1121-4d79-8de0-0b3439bf3839 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:27.882340 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9d1fa-1121-4d79-8de0-0b3439bf3839 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:27.882847 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9d1fa-1121-4d79-8de0-0b3439bf3839 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:27.884174 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9d1fa-1121-4d79-8de0-0b3439bf3839 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:27.886139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9d1fa-1121-4d79-8de0-0b3439bf3839 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:27.902103 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fca953-0f2b-43f4-b87c-e1b9b04e9a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-01f9d1fa-1121-4d79-8de0-0b3439bf3839 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:27.902994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:27.903871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:36:27.904766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:27.905538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fca953-0f2b-43f4-b87c-e1b9b04e9a69 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:27.905538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fca953-0f2b-43f4-b87c-e1b9b04e9a69 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:27.905538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fca953-0f2b-43f4-b87c-e1b9b04e9a69 None admin] PATH_INFO: `/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/b82d01982ea7412aa396b517ed80bd4c/roles/f315b062be7e445fa9461a116f9c46ee` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:27.907897 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 355/699] 10.222.0.24 () {56 vars in 1129 bytes} [Sat Jun 4 20:36:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:27.912808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fca953-0f2b-43f4-b87c-e1b9b04e9a69 None admin] RBAC: Authorizing `identity:create_grant(project_id=793a7b858d3848b3b0df4e9c31d20d2a, user_id=b82d01982ea7412aa396b517ed80bd4c, role_id=f315b062be7e445fa9461a116f9c46ee)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:27.912808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fca953-0f2b-43f4-b87c-e1b9b04e9a69 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:27.914209 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9d1fa-1121-4d79-8de0-0b3439bf3839 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:27.937458 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 345/700] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:36:27 2022] PUT /identity/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/b82d01982ea7412aa396b517ed80bd4c/roles/f315b062be7e445fa9461a116f9c46ee => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:36:28.047292 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:28.123726 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9d1fa-1121-4d79-8de0-0b3439bf3839 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:28.172770 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa63e9-b180-4698-9af7-6cb2cef3164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:28.173370 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa63e9-b180-4698-9af7-6cb2cef3164d None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:28.173658 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa63e9-b180-4698-9af7-6cb2cef3164d None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:28.173938 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa63e9-b180-4698-9af7-6cb2cef3164d None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:28.174772 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa63e9-b180-4698-9af7-6cb2cef3164d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:28.175093 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa63e9-b180-4698-9af7-6cb2cef3164d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:28.176563 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa63e9-b180-4698-9af7-6cb2cef3164d None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:28.183337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 356/701] 10.222.0.24 () {56 vars in 1124 bytes} [Sat Jun 4 20:36:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:28.192793 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fca953-0f2b-43f4-b87c-e1b9b04e9a69 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:28.254658 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31eca5-b33a-4949-813d-4a9fd58557b8 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:28.255083 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31eca5-b33a-4949-813d-4a9fd58557b8 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:28.255226 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31eca5-b33a-4949-813d-4a9fd58557b8 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:28.257504 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 357/702] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:28.263102 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b34a8f-3d42-41e1-b677-b15cb785f463 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:28.263456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b34a8f-3d42-41e1-b677-b15cb785f463 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:28.263699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b34a8f-3d42-41e1-b677-b15cb785f463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:28.273402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:28.282904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-a4b34a8f-3d42-41e1-b677-b15cb785f463 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:28.284119 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-a4b34a8f-3d42-41e1-b677-b15cb785f463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:28.371856 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 358/703] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:28 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:36:28.398492 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b34a8f-3d42-41e1-b677-b15cb785f463 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:28.416379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fca953-0f2b-43f4-b87c-e1b9b04e9a69 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:28.461489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1239c-4fd8-4d70-a459-8ca21f4b4c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:28.462341 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1239c-4fd8-4d70-a459-8ca21f4b4c13 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:28.462481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1239c-4fd8-4d70-a459-8ca21f4b4c13 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:28.462729 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1239c-4fd8-4d70-a459-8ca21f4b4c13 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:28.463458 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1239c-4fd8-4d70-a459-8ca21f4b4c13 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:28.463764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1239c-4fd8-4d70-a459-8ca21f4b4c13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:28.465220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed1239c-4fd8-4d70-a459-8ca21f4b4c13 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:28.477997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 346/704] 10.222.0.24 () {56 vars in 1124 bytes} [Sat Jun 4 20:36:28 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:28.482257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1239c-4fd8-4d70-a459-8ca21f4b4c13 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:28.506413 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:28.565166 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b34a8f-3d42-41e1-b677-b15cb785f463 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:28.607650 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d1cff-f0da-4078-87a0-d0053537c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:28.608504 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1cff-f0da-4078-87a0-d0053537c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:28.608792 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1cff-f0da-4078-87a0-d0053537c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:28.609078 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d1cff-f0da-4078-87a0-d0053537c3c6 None admin] PATH_INFO: `/v3/services/image` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:28.609863 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d1cff-f0da-4078-87a0-d0053537c3c6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:28.611263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d1cff-f0da-4078-87a0-d0053537c3c6 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-5d5d1cff-f0da-4078-87a0-d0053537c3c6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:28.624575 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:28.626556 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 04 20:36:28.628169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:28.631968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 359/705] 10.222.0.24 () {56 vars in 1105 bytes} [Sat Jun 4 20:36:28 2022] GET /identity/v3/services/image => generated 86 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:28.633046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d1cff-f0da-4078-87a0-d0053537c3c6 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:28.708672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1239c-4fd8-4d70-a459-8ca21f4b4c13 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:28.711306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:28.751835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f33a41-3873-49da-b308-7af90153a11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:28.752499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f33a41-3873-49da-b308-7af90153a11e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:28.752783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f33a41-3873-49da-b308-7af90153a11e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:28.753063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f33a41-3873-49da-b308-7af90153a11e None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:28.754132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f33a41-3873-49da-b308-7af90153a11e None admin] RBAC: Adding query filter params (interface=public, service_id=f63dcc94f51347da86645a8d7a04930c, region_id=RegionOne) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:28.754321 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f33a41-3873-49da-b308-7af90153a11e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:28.755665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f33a41-3873-49da-b308-7af90153a11e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:28.768464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 347/706] 10.222.0.24 () {56 vars in 1251 bytes} [Sat Jun 4 20:36:28 2022] GET /identity/v3/endpoints?service_id=f63dcc94f51347da86645a8d7a04930c&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:28.772393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f33a41-3873-49da-b308-7af90153a11e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:28.847128 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d1cff-f0da-4078-87a0-d0053537c3c6 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:28.888036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f33a41-3873-49da-b308-7af90153a11e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:28.892426 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:28.914860 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae723b-c983-4ff6-9f52-35f884f10f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:28.916348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae723b-c983-4ff6-9f52-35f884f10f8b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:28.917057 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae723b-c983-4ff6-9f52-35f884f10f8b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:28.917772 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ae723b-c983-4ff6-9f52-35f884f10f8b None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:28.919269 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae723b-c983-4ff6-9f52-35f884f10f8b None admin] RBAC: Adding query filter params (name=image) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:28.920005 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae723b-c983-4ff6-9f52-35f884f10f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:28.922659 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ae723b-c983-4ff6-9f52-35f884f10f8b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:28.930397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff418768-ffaa-40c6-aac5-348a9df590e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:28.931175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff418768-ffaa-40c6-aac5-348a9df590e1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:28.931524 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff418768-ffaa-40c6-aac5-348a9df590e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:28.931864 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff418768-ffaa-40c6-aac5-348a9df590e1 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:28.932753 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff418768-ffaa-40c6-aac5-348a9df590e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:28.933769 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 360/707] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:28.937451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff418768-ffaa-40c6-aac5-348a9df590e1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:28.940128 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae723b-c983-4ff6-9f52-35f884f10f8b None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:28.961579 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 348/708] 10.222.0.24 () {56 vars in 1087 bytes} [Sat Jun 4 20:36:28 2022] GET /identity/v3/services => generated 1002 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:36:29.122685 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ae723b-c983-4ff6-9f52-35f884f10f8b None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:29.197520 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b8e64-94f5-4674-a1c9-03b7de8afafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:29.199355 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b8e64-94f5-4674-a1c9-03b7de8afafc None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:29.200160 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b8e64-94f5-4674-a1c9-03b7de8afafc None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:29.200967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b8e64-94f5-4674-a1c9-03b7de8afafc None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:29.202608 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b8e64-94f5-4674-a1c9-03b7de8afafc None admin] RBAC: Adding query filter params (type=image) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:29.203448 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b8e64-94f5-4674-a1c9-03b7de8afafc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:29.206653 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b8e64-94f5-4674-a1c9-03b7de8afafc None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:29.218237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 361/709] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:29.223784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff418768-ffaa-40c6-aac5-348a9df590e1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:29.279098 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:29.383178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff418768-ffaa-40c6-aac5-348a9df590e1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:29.428968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c85314-357b-4dbf-9b8a-333984a4c064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:29.430040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85314-357b-4dbf-9b8a-333984a4c064 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:29.430040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85314-357b-4dbf-9b8a-333984a4c064 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:29.430040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85314-357b-4dbf-9b8a-333984a4c064 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:29.430795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c85314-357b-4dbf-9b8a-333984a4c064 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:29.432253 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c85314-357b-4dbf-9b8a-333984a4c064 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:29.464096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 349/710] 10.222.0.24 () {60 vars in 1144 bytes} [Sat Jun 4 20:36:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:29.846894 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688f16-8f21-49a5-9e60-ce0ea8b28ea9 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:29.847634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688f16-8f21-49a5-9e60-ce0ea8b28ea9 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:29.847634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80688f16-8f21-49a5-9e60-ce0ea8b28ea9 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:29.849281 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 362/711] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:29.855995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfb2e9-e9fa-4c56-b420-541b5692a750 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:29.856412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfb2e9-e9fa-4c56-b420-541b5692a750 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:29.856614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddfb2e9-e9fa-4c56-b420-541b5692a750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:29.881961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-eddfb2e9-e9fa-4c56-b420-541b5692a750 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:29.882871 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-eddfb2e9-e9fa-4c56-b420-541b5692a750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:29.972554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 350/712] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:29 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:30.001865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688f16-8f21-49a5-9e60-ce0ea8b28ea9 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:30.105960 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:30.213239 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80688f16-8f21-49a5-9e60-ce0ea8b28ea9 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:30.274452 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd69397-9e2d-49ad-bf65-7e6f097405ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:30.275468 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd69397-9e2d-49ad-bf65-7e6f097405ba None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:30.275955 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd69397-9e2d-49ad-bf65-7e6f097405ba None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:30.276462 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd69397-9e2d-49ad-bf65-7e6f097405ba None admin] PATH_INFO: `/v3/services/network` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:30.277852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd69397-9e2d-49ad-bf65-7e6f097405ba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:30.280375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd69397-9e2d-49ad-bf65-7e6f097405ba None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-2dd69397-9e2d-49ad-bf65-7e6f097405ba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:30.294059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:30.295911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:30.297656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 363/713] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:30 2022] GET /identity/v3/services/network => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:30.304487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfb2e9-e9fa-4c56-b420-541b5692a750 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:30.329111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:30.495774 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddfb2e9-e9fa-4c56-b420-541b5692a750 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:30.575839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e1f9fa-2399-4dec-9683-0796c76a399e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:30.577509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1f9fa-2399-4dec-9683-0796c76a399e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:30.578290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1f9fa-2399-4dec-9683-0796c76a399e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:30.579037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1f9fa-2399-4dec-9683-0796c76a399e None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:30.580721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1f9fa-2399-4dec-9683-0796c76a399e None admin] RBAC: Adding query filter params (name=network) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:30.581530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1f9fa-2399-4dec-9683-0796c76a399e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:30.584551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e1f9fa-2399-4dec-9683-0796c76a399e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:30.595298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 351/714] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:36:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:30.605017 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd69397-9e2d-49ad-bf65-7e6f097405ba None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:30.794549 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd69397-9e2d-49ad-bf65-7e6f097405ba None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:30.811367 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:30.824002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12518482-556b-472f-a4d8-5a0396d01c23 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:30.827780 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12518482-556b-472f-a4d8-5a0396d01c23 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:30.827780 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12518482-556b-472f-a4d8-5a0396d01c23 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:30.827780 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 352/715] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:30.838674 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8783e9c-da20-4693-a082-f9c35a25afc4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:30.839326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8783e9c-da20-4693-a082-f9c35a25afc4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:30.839904 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8783e9c-da20-4693-a082-f9c35a25afc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:30.843263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c841f54-160f-4a14-aef6-8fae77223d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:30.844398 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c841f54-160f-4a14-aef6-8fae77223d68 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:30.844884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c841f54-160f-4a14-aef6-8fae77223d68 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:30.845353 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c841f54-160f-4a14-aef6-8fae77223d68 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:30.846622 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c841f54-160f-4a14-aef6-8fae77223d68 None admin] RBAC: Adding query filter params (type=network) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:30.847143 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c841f54-160f-4a14-aef6-8fae77223d68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:30.849611 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c841f54-160f-4a14-aef6-8fae77223d68 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:30.859318 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 364/716] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:36:30 2022] GET /identity/v3/services?type=network => generated 350 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:30.867503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c841f54-160f-4a14-aef6-8fae77223d68 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:30.877869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f8783e9c-da20-4693-a082-f9c35a25afc4 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:30.879759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f8783e9c-da20-4693-a082-f9c35a25afc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:31.028655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 353/717] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:30 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:36:31.068271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8783e9c-da20-4693-a082-f9c35a25afc4 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:31.085405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:31.094680 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c841f54-160f-4a14-aef6-8fae77223d68 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:31.166303 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b7810-773f-4793-a36e-37a4e28a502f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:31.167772 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b7810-773f-4793-a36e-37a4e28a502f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.168299 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b7810-773f-4793-a36e-37a4e28a502f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.169547 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b7810-773f-4793-a36e-37a4e28a502f None admin] PATH_INFO: `/v3/endpoints` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.171840 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b7810-773f-4793-a36e-37a4e28a502f None admin] RBAC: Adding query filter params (interface=public, service_id=c961b508b43340cdad6ac6f013f63a23, region_id=RegionOne) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:31.172395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b7810-773f-4793-a36e-37a4e28a502f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:31.175741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b7810-773f-4793-a36e-37a4e28a502f None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:31.200386 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 365/718] 10.222.0.24 () {56 vars in 1251 bytes} [Sat Jun 4 20:36:30 2022] GET /identity/v3/endpoints?service_id=c961b508b43340cdad6ac6f013f63a23&interface=public®ion_id=RegionOne => generated 194 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:31.210567 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b7810-773f-4793-a36e-37a4e28a502f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:31.264492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8783e9c-da20-4693-a082-f9c35a25afc4 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:31.299194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:31.330728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4804b83-b27f-4bce-bb55-dbd366e4dd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:31.332173 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4804b83-b27f-4bce-bb55-dbd366e4dd4b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.332725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4804b83-b27f-4bce-bb55-dbd366e4dd4b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.333308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4804b83-b27f-4bce-bb55-dbd366e4dd4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.352928 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4804b83-b27f-4bce-bb55-dbd366e4dd4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-f4804b83-b27f-4bce-bb55-dbd366e4dd4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:36:31.367325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:31.369533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:36:31.371601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:31.381053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 354/719] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:36:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:31.384036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4804b83-b27f-4bce-bb55-dbd366e4dd4b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:31.417311 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b7810-773f-4793-a36e-37a4e28a502f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:31.479976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5f356-dbe4-4abf-b95a-e1a44c778483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:31.481381 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5f356-dbe4-4abf-b95a-e1a44c778483 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.482028 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5f356-dbe4-4abf-b95a-e1a44c778483 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.482670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a5f356-dbe4-4abf-b95a-e1a44c778483 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.484077 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5f356-dbe4-4abf-b95a-e1a44c778483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:31.486831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a5f356-dbe4-4abf-b95a-e1a44c778483 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:31.498021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 366/720] 10.222.0.24 () {56 vars in 1087 bytes} [Sat Jun 4 20:36:31 2022] GET /identity/v3/services => generated 1002 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:36:31.517684 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:31.569893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4804b83-b27f-4bce-bb55-dbd366e4dd4b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:31.633824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d755e7-1a93-4b5f-a690-4ad4c119d18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:31.634897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d755e7-1a93-4b5f-a690-4ad4c119d18b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.635389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d755e7-1a93-4b5f-a690-4ad4c119d18b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.635882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d755e7-1a93-4b5f-a690-4ad4c119d18b None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.637487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d755e7-1a93-4b5f-a690-4ad4c119d18b None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:31.638041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d755e7-1a93-4b5f-a690-4ad4c119d18b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:31.641312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d755e7-1a93-4b5f-a690-4ad4c119d18b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:31.664601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 355/721] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:31.669923 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5f356-dbe4-4abf-b95a-e1a44c778483 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:31.863159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a5f356-dbe4-4abf-b95a-e1a44c778483 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:31.872650 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:31.909736 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ac393-ea01-43eb-b5df-df39710f6fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:31.910479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ac393-ea01-43eb-b5df-df39710f6fdc None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:31.910761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ac393-ea01-43eb-b5df-df39710f6fdc None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:31.911037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ac393-ea01-43eb-b5df-df39710f6fdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:31.925414 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ac393-ea01-43eb-b5df-df39710f6fdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:31.927019 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ac393-ea01-43eb-b5df-df39710f6fdc None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-df0ac393-ea01-43eb-b5df-df39710f6fdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:31.947533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:31.949382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:31.951217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:31.951217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:31.951217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:31.951217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:31.951217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 367/722] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:31.958466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d755e7-1a93-4b5f-a690-4ad4c119d18b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:32.154886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d755e7-1a93-4b5f-a690-4ad4c119d18b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:32.189799 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:32.203345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cef7b7-13ba-4387-bce1-11d8a2bc846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:32.204501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cef7b7-13ba-4387-bce1-11d8a2bc846b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.205000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cef7b7-13ba-4387-bce1-11d8a2bc846b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.205485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cef7b7-13ba-4387-bce1-11d8a2bc846b None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.206520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cef7b7-13ba-4387-bce1-11d8a2bc846b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:32.207046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cef7b7-13ba-4387-bce1-11d8a2bc846b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:32.208929 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cef7b7-13ba-4387-bce1-11d8a2bc846b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:32.225690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 356/723] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:32.232975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ac393-ea01-43eb-b5df-df39710f6fdc None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:32.363042 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ac393-ea01-43eb-b5df-df39710f6fdc None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:32.405145 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8c3c6-d6f0-49d7-baf9-4df0e48c171c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:32.405981 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8c3c6-d6f0-49d7-baf9-4df0e48c171c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.406266 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8c3c6-d6f0-49d7-baf9-4df0e48c171c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.406546 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8c3c6-d6f0-49d7-baf9-4df0e48c171c None admin] PATH_INFO: `/v3/users/nova` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.416569 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8c3c6-d6f0-49d7-baf9-4df0e48c171c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:32.418193 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8c3c6-d6f0-49d7-baf9-4df0e48c171c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-97b8c3c6-d6f0-49d7-baf9-4df0e48c171c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:32.434489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:32.436108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:32.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:32.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:32.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:32.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:32.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:32.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:32.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:32.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:32.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 04 20:36:32.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:32.437825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 368/724] 10.222.0.24 () {56 vars in 1093 bytes} [Sat Jun 4 20:36:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:32.445538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cef7b7-13ba-4387-bce1-11d8a2bc846b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:32.664283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cef7b7-13ba-4387-bce1-11d8a2bc846b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:32.734175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f923c781-ece2-4969-920e-a19fe39a3a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:32.735342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c781-ece2-4969-920e-a19fe39a3a15 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.735846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c781-ece2-4969-920e-a19fe39a3a15 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.736334 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f923c781-ece2-4969-920e-a19fe39a3a15 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.738117 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923c781-ece2-4969-920e-a19fe39a3a15 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:32.738661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923c781-ece2-4969-920e-a19fe39a3a15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:32.741940 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f923c781-ece2-4969-920e-a19fe39a3a15 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:32.781685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 357/725] 10.222.0.24 () {56 vars in 1133 bytes} [Sat Jun 4 20:36:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:32.790900 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8c3c6-d6f0-49d7-baf9-4df0e48c171c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:32.829046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:32.920341 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8c3c6-d6f0-49d7-baf9-4df0e48c171c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:32.929882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692d72-46c8-4a95-9b59-bf93bd52ffdb None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.930836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692d72-46c8-4a95-9b59-bf93bd52ffdb None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.931670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b692d72-46c8-4a95-9b59-bf93bd52ffdb None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.934722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 358/726] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:32.937678 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d429d-4275-4366-ac24-68df3c3ea348 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.938306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d429d-4275-4366-ac24-68df3c3ea348 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.939571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d429d-4275-4366-ac24-68df3c3ea348 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.943432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 359/727] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:32.946470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00438a-2344-455e-b32e-fd7c0431acdd None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.947305 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00438a-2344-455e-b32e-fd7c0431acdd None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.948050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00438a-2344-455e-b32e-fd7c0431acdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:32.976264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-9b00438a-2344-455e-b32e-fd7c0431acdd None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:32.978240 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-9b00438a-2344-455e-b32e-fd7c0431acdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:32.979881 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be4ff5-6af0-4900-afe7-a0963caf9c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:32.980973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be4ff5-6af0-4900-afe7-a0963caf9c67 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:32.981411 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be4ff5-6af0-4900-afe7-a0963caf9c67 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:32.981945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be4ff5-6af0-4900-afe7-a0963caf9c67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:33.074512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:33.115302 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be4ff5-6af0-4900-afe7-a0963caf9c67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:33.118089 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be4ff5-6af0-4900-afe7-a0963caf9c67 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:33.134724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 360/728] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:32 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:33.134724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60dbba-53bb-47dd-b7ad-83cd124dfed9 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:33.134724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60dbba-53bb-47dd-b7ad-83cd124dfed9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:33.134724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60dbba-53bb-47dd-b7ad-83cd124dfed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:33.157001 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:33.165455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-5c60dbba-53bb-47dd-b7ad-83cd124dfed9 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:33.167492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-5c60dbba-53bb-47dd-b7ad-83cd124dfed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:33.290613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 361/729] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:33 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:33.292573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60dbba-53bb-47dd-b7ad-83cd124dfed9 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:33.329159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 369/730] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:32 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:36:33.331025 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be4ff5-6af0-4900-afe7-a0963caf9c67 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:33.468902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60dbba-53bb-47dd-b7ad-83cd124dfed9 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:33.485555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:33.495033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be4ff5-6af0-4900-afe7-a0963caf9c67 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:33.526468 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:33.540974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fa48c-6fa6-4bee-a31c-234391795437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:33.542361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fa48c-6fa6-4bee-a31c-234391795437 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:33.542813 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fa48c-6fa6-4bee-a31c-234391795437 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:33.543292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fa48c-6fa6-4bee-a31c-234391795437 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:33.544543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fa48c-6fa6-4bee-a31c-234391795437 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:33.547036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fa48c-6fa6-4bee-a31c-234391795437 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:33.549832 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614df8f-b596-4904-8d03-68ed647ec9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:33.550866 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614df8f-b596-4904-8d03-68ed647ec9a3 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:33.551252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614df8f-b596-4904-8d03-68ed647ec9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:33.551688 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614df8f-b596-4904-8d03-68ed647ec9a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:33.565846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614df8f-b596-4904-8d03-68ed647ec9a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:33.568703 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d614df8f-b596-4904-8d03-68ed647ec9a3 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-a27fa48c-6fa6-4bee-a31c-234391795437 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:33.569714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:33.571417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:33.574271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 362/731] 10.222.0.24 () {56 vars in 1129 bytes} [Sat Jun 4 20:36:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:33.577458 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fa48c-6fa6-4bee-a31c-234391795437 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-d614df8f-b596-4904-8d03-68ed647ec9a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:33.609307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:33.611113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:33.614662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:33.614662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:33.614662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:33.614662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:33.614662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 370/732] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:33.614662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614df8f-b596-4904-8d03-68ed647ec9a3 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:33.760782 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fa48c-6fa6-4bee-a31c-234391795437 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:33.802133 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614df8f-b596-4904-8d03-68ed647ec9a3 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:33.803872 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080d5f2-f84d-472a-b776-e70768f2de95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:33.804589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080d5f2-f84d-472a-b776-e70768f2de95 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:33.804870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080d5f2-f84d-472a-b776-e70768f2de95 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:33.805140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4080d5f2-f84d-472a-b776-e70768f2de95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:33.855200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:33.873138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d12e0-8055-47dd-ad1e-4a7cfc7483a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:33.874154 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d12e0-8055-47dd-ad1e-4a7cfc7483a8 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:33.874657 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d12e0-8055-47dd-ad1e-4a7cfc7483a8 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:33.875148 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d12e0-8055-47dd-ad1e-4a7cfc7483a8 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:33.876477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d12e0-8055-47dd-ad1e-4a7cfc7483a8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:33.877028 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d12e0-8055-47dd-ad1e-4a7cfc7483a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:33.879721 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d12e0-8055-47dd-ad1e-4a7cfc7483a8 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:33.892491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 371/733] 10.222.0.24 () {56 vars in 1124 bytes} [Sat Jun 4 20:36:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:33.892491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d12e0-8055-47dd-ad1e-4a7cfc7483a8 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:33.903031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080d5f2-f84d-472a-b776-e70768f2de95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:33.905054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4080d5f2-f84d-472a-b776-e70768f2de95 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:33.959939 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:34.070551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 363/734] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:36:33 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:36:34.072362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080d5f2-f84d-472a-b776-e70768f2de95 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:34.093337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d12e0-8055-47dd-ad1e-4a7cfc7483a8 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:34.151861 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b733ba0-7923-4cbf-8858-3b269286caa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:34.152969 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b733ba0-7923-4cbf-8858-3b269286caa1 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:34.153479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b733ba0-7923-4cbf-8858-3b269286caa1 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:34.153982 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b733ba0-7923-4cbf-8858-3b269286caa1 None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:34.155394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b733ba0-7923-4cbf-8858-3b269286caa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:34.155957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b733ba0-7923-4cbf-8858-3b269286caa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:34.158689 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b733ba0-7923-4cbf-8858-3b269286caa1 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:34.183315 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 372/735] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:34.184992 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b733ba0-7923-4cbf-8858-3b269286caa1 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:34.193657 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:34.234172 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4080d5f2-f84d-472a-b776-e70768f2de95 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:34.281007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da2520-cff3-4fcb-9b19-a55836b7cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:34.282006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da2520-cff3-4fcb-9b19-a55836b7cf1f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:34.282365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da2520-cff3-4fcb-9b19-a55836b7cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:34.282694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da2520-cff3-4fcb-9b19-a55836b7cf1f None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:34.283493 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da2520-cff3-4fcb-9b19-a55836b7cf1f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:34.283852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da2520-cff3-4fcb-9b19-a55836b7cf1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:34.285747 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3da2520-cff3-4fcb-9b19-a55836b7cf1f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:34.292254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 364/736] 10.222.0.24 () {56 vars in 1124 bytes} [Sat Jun 4 20:36:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:34.293690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da2520-cff3-4fcb-9b19-a55836b7cf1f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:34.393476 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:34.405382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b733ba0-7923-4cbf-8858-3b269286caa1 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:34.447296 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da2520-cff3-4fcb-9b19-a55836b7cf1f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:34.456081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac199-f5ec-4a55-8597-34f81c5a2273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:34.457084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac199-f5ec-4a55-8597-34f81c5a2273 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:34.457487 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac199-f5ec-4a55-8597-34f81c5a2273 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:34.457884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac199-f5ec-4a55-8597-34f81c5a2273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:34.473383 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ac199-f5ec-4a55-8597-34f81c5a2273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:34.475455 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ac199-f5ec-4a55-8597-34f81c5a2273 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-835ac199-f5ec-4a55-8597-34f81c5a2273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:36:34.495255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:34.496995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:34.498748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:36:34.498748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:36:34.498748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:36:34.498748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:34.498748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 373/737] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:34.498748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac199-f5ec-4a55-8597-34f81c5a2273 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:34.530051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550105c-bfc3-46a5-aa68-1c9d1bf59db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:34.531438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550105c-bfc3-46a5-aa68-1c9d1bf59db2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:34.531933 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550105c-bfc3-46a5-aa68-1c9d1bf59db2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:34.532393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550105c-bfc3-46a5-aa68-1c9d1bf59db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:34.536411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:34.547135 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550105c-bfc3-46a5-aa68-1c9d1bf59db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:34.549870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550105c-bfc3-46a5-aa68-1c9d1bf59db2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-6550105c-bfc3-46a5-aa68-1c9d1bf59db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:34.577376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:34.578585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:34.580942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:34.580942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:34.580942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:34.580942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:34.580942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:34.580942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:34.580942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:34.580942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:34.580942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 365/738] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:34.581912 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550105c-bfc3-46a5-aa68-1c9d1bf59db2 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:34.622097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac199-f5ec-4a55-8597-34f81c5a2273 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:34.677108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf4da0-099d-4d39-96ee-83a6b90ddb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:34.678253 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf4da0-099d-4d39-96ee-83a6b90ddb92 None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:34.678762 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf4da0-099d-4d39-96ee-83a6b90ddb92 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:34.679257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf4da0-099d-4d39-96ee-83a6b90ddb92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:34.680713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf4da0-099d-4d39-96ee-83a6b90ddb92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:34.683422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf4da0-099d-4d39-96ee-83a6b90ddb92 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:34.714251 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550105c-bfc3-46a5-aa68-1c9d1bf59db2 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:34.715608 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 374/739] 10.222.0.24 () {60 vars in 1144 bytes} [Sat Jun 4 20:36:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:34.717187 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a27ae7-6d9a-40ff-b471-c1d03d9241df None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:34.717581 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a27ae7-6d9a-40ff-b471-c1d03d9241df None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:34.717940 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a27ae7-6d9a-40ff-b471-c1d03d9241df None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:34.719321 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 375/740] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:34.720263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a27ae7-6d9a-40ff-b471-c1d03d9241df None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:34.727975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:34.786574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35695-f5a8-41bb-aa22-c1de7b55d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:34.787911 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35695-f5a8-41bb-aa22-c1de7b55d8bd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:34.788366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35695-f5a8-41bb-aa22-c1de7b55d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:34.788846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35695-f5a8-41bb-aa22-c1de7b55d8bd None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:34.790057 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35695-f5a8-41bb-aa22-c1de7b55d8bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:34.790553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35695-f5a8-41bb-aa22-c1de7b55d8bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:34.792305 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35695-f5a8-41bb-aa22-c1de7b55d8bd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:34.823204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 366/741] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:34.823204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ae8d-0686-4c62-b71f-6f683eaec27a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:34.823204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ae8d-0686-4c62-b71f-6f683eaec27a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:34.823204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5ae8d-0686-4c62-b71f-6f683eaec27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:34.843313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-11c5ae8d-0686-4c62-b71f-6f683eaec27a None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:34.845474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-11c5ae8d-0686-4c62-b71f-6f683eaec27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:34.931641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:34.950530 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a27ae7-6d9a-40ff-b471-c1d03d9241df None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:34.980470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 367/742] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:34 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:35.014224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5ae8d-0686-4c62-b71f-6f683eaec27a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:35.035900 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ad46c-ea05-4fa5-9dfc-99619529cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:35.039331 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ad46c-ea05-4fa5-9dfc-99619529cba1 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:35.040145 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ad46c-ea05-4fa5-9dfc-99619529cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:35.041287 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852ad46c-ea05-4fa5-9dfc-99619529cba1 None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:35.043821 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ad46c-ea05-4fa5-9dfc-99619529cba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:35.045145 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ad46c-ea05-4fa5-9dfc-99619529cba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:35.048287 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852ad46c-ea05-4fa5-9dfc-99619529cba1 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:35.073879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 376/743] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:35.086013 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ad46c-ea05-4fa5-9dfc-99619529cba1 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:35.195202 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:35.243530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5ae8d-0686-4c62-b71f-6f683eaec27a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:35.244027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852ad46c-ea05-4fa5-9dfc-99619529cba1 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:35.301126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2821f90-54ba-44de-b4cc-4d3f050935b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:35.302130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2821f90-54ba-44de-b4cc-4d3f050935b9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:35.302496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2821f90-54ba-44de-b4cc-4d3f050935b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:35.302764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2821f90-54ba-44de-b4cc-4d3f050935b9 None admin] PATH_INFO: `/v3/services/network` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:35.303569 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2821f90-54ba-44de-b4cc-4d3f050935b9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:35.305549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2821f90-54ba-44de-b4cc-4d3f050935b9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:35.313640 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af34be9-3577-4bef-9198-26e489000d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:35.314774 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af34be9-3577-4bef-9198-26e489000d8c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:35.315256 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af34be9-3577-4bef-9198-26e489000d8c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:35.315733 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af34be9-3577-4bef-9198-26e489000d8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:35.317337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af34be9-3577-4bef-9198-26e489000d8c None admin] RBAC: Adding query filter params (role.id=f315b062be7e445fa9461a116f9c46ee, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=b82d01982ea7412aa396b517ed80bd4c) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:35.318372 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af34be9-3577-4bef-9198-26e489000d8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-d2821f90-54ba-44de-b4cc-4d3f050935b9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:35.318730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:35.320890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:35.322741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 368/744] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:35 2022] GET /identity/v3/services/network => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:35.324305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af34be9-3577-4bef-9198-26e489000d8c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:35.327017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2821f90-54ba-44de-b4cc-4d3f050935b9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:35.333272 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 377/745] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:36:35 2022] GET /identity/v3/role_assignments?user.id=b82d01982ea7412aa396b517ed80bd4c&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=f315b062be7e445fa9461a116f9c46ee => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:35.429538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:35.554624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2821f90-54ba-44de-b4cc-4d3f050935b9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:35.609569 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a8075-fdbb-4c45-a017-7a95e3dc0182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:35.610705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a8075-fdbb-4c45-a017-7a95e3dc0182 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:35.611193 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a8075-fdbb-4c45-a017-7a95e3dc0182 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:35.611695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a8075-fdbb-4c45-a017-7a95e3dc0182 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:35.613144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a8075-fdbb-4c45-a017-7a95e3dc0182 None admin] RBAC: Adding query filter params (name=network) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:35.613672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a8075-fdbb-4c45-a017-7a95e3dc0182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:35.616384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a8075-fdbb-4c45-a017-7a95e3dc0182 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:35.625597 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 369/746] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:36:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:35.637676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af34be9-3577-4bef-9198-26e489000d8c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:35.846482 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af34be9-3577-4bef-9198-26e489000d8c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:35.898354 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:35.917584 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763c096-f976-48b2-a928-a476de4ea332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:35.918735 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763c096-f976-48b2-a928-a476de4ea332 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:35.919238 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763c096-f976-48b2-a928-a476de4ea332 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:35.919723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763c096-f976-48b2-a928-a476de4ea332 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:35.922002 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763c096-f976-48b2-a928-a476de4ea332 None admin] RBAC: Adding query filter params (type=network) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:35.922574 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763c096-f976-48b2-a928-a476de4ea332 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:35.925331 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763c096-f976-48b2-a928-a476de4ea332 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:35.943392 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 378/747] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:36:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:35.945489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a8075-fdbb-4c45-a017-7a95e3dc0182 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:36.076982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a8075-fdbb-4c45-a017-7a95e3dc0182 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:36.091300 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:36.127182 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5d1c0-0667-4492-9ed7-6684e8d0965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:36.127952 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5d1c0-0667-4492-9ed7-6684e8d0965c None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:36.128365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5d1c0-0667-4492-9ed7-6684e8d0965c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:36.128816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5d1c0-0667-4492-9ed7-6684e8d0965c None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:36.129704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5d1c0-0667-4492-9ed7-6684e8d0965c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:36.131300 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5d1c0-0667-4492-9ed7-6684e8d0965c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:36.160475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 370/748] 10.222.0.24 () {60 vars in 1144 bytes} [Sat Jun 4 20:36:35 2022] POST /identity/v3/endpoints => generated 327 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:38.027723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a117820-726c-4635-83dd-0f52b4bdf329 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.028543 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a117820-726c-4635-83dd-0f52b4bdf329 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.028543 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a117820-726c-4635-83dd-0f52b4bdf329 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.030049 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 379/749] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:38.036684 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0648-142d-44c4-a860-2b3ff9d77805 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.037409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0648-142d-44c4-a860-2b3ff9d77805 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.037409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b0648-142d-44c4-a860-2b3ff9d77805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.055211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f01b0648-142d-44c4-a860-2b3ff9d77805 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:38.056475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f01b0648-142d-44c4-a860-2b3ff9d77805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:38.152063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 371/750] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:38 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:38.175405 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a117820-726c-4635-83dd-0f52b4bdf329 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.303973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a117820-726c-4635-83dd-0f52b4bdf329 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.343721 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fc626-0dca-440b-9cbd-b23689b9fd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.345174 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fc626-0dca-440b-9cbd-b23689b9fd01 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.345675 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fc626-0dca-440b-9cbd-b23689b9fd01 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.346175 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fc626-0dca-440b-9cbd-b23689b9fd01 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.347365 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fc626-0dca-440b-9cbd-b23689b9fd01 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.350274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fc626-0dca-440b-9cbd-b23689b9fd01 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.357500 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5ae3d-b271-429e-bdc9-8cbb67c0dfba None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.357873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5ae3d-b271-429e-bdc9-8cbb67c0dfba None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.358241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5ae3d-b271-429e-bdc9-8cbb67c0dfba None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.359722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 372/751] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:38.365584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5b78-7d45-4d2f-8f3d-b7d544cc57b4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.365867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5b78-7d45-4d2f-8f3d-b7d544cc57b4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.366147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989f5b78-7d45-4d2f-8f3d-b7d544cc57b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-962fc626-0dca-440b-9cbd-b23689b9fd01 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:38.373183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:38.374488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:38.375723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 380/752] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:38.382378 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fc626-0dca-440b-9cbd-b23689b9fd01 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.384462 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-989f5b78-7d45-4d2f-8f3d-b7d544cc57b4 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:38.385680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-989f5b78-7d45-4d2f-8f3d-b7d544cc57b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:38.465559 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:38.466532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 373/753] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:38 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:36:38.490207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f5b78-7d45-4d2f-8f3d-b7d544cc57b4 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.517446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:38.523431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fc626-0dca-440b-9cbd-b23689b9fd01 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.582625 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2639eab-6887-47a9-8f8f-a9f8a6535c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.583339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639eab-6887-47a9-8f8f-a9f8a6535c40 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.583805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639eab-6887-47a9-8f8f-a9f8a6535c40 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.584085 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2639eab-6887-47a9-8f8f-a9f8a6535c40 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.591515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2639eab-6887-47a9-8f8f-a9f8a6535c40 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:38.591953 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2639eab-6887-47a9-8f8f-a9f8a6535c40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.593624 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2639eab-6887-47a9-8f8f-a9f8a6535c40 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.599941 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 381/754] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:38.605870 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2639eab-6887-47a9-8f8f-a9f8a6535c40 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.620681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989f5b78-7d45-4d2f-8f3d-b7d544cc57b4 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.657874 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c8d2b-2224-4728-8fe9-a3c6f4a1e3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.658712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c8d2b-2224-4728-8fe9-a3c6f4a1e3aa None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.658997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c8d2b-2224-4728-8fe9-a3c6f4a1e3aa None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.659265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c8d2b-2224-4728-8fe9-a3c6f4a1e3aa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.659940 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c8d2b-2224-4728-8fe9-a3c6f4a1e3aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.661395 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c8d2b-2224-4728-8fe9-a3c6f4a1e3aa None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-820c8d2b-2224-4728-8fe9-a3c6f4a1e3aa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:38.674795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:38.675873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:38.676702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 374/755] 10.222.0.24 () {56 vars in 1132 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:38.682549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c8d2b-2224-4728-8fe9-a3c6f4a1e3aa None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:38.718756 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2639eab-6887-47a9-8f8f-a9f8a6535c40 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.742712 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:38.765845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58bdbe-1eca-4388-8b09-5710d5bf06d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.766527 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58bdbe-1eca-4388-8b09-5710d5bf06d0 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.766811 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58bdbe-1eca-4388-8b09-5710d5bf06d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.767088 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58bdbe-1eca-4388-8b09-5710d5bf06d0 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.767816 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58bdbe-1eca-4388-8b09-5710d5bf06d0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:38.768120 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58bdbe-1eca-4388-8b09-5710d5bf06d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.769565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58bdbe-1eca-4388-8b09-5710d5bf06d0 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.774954 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 382/756] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:38.782387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:38.814141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c8d2b-2224-4728-8fe9-a3c6f4a1e3aa None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:38.870615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec54d63-12c1-4235-aa7e-473cc2581612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:38.871213 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec54d63-12c1-4235-aa7e-473cc2581612 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:38.871501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec54d63-12c1-4235-aa7e-473cc2581612 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:38.871777 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec54d63-12c1-4235-aa7e-473cc2581612 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:38.872547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec54d63-12c1-4235-aa7e-473cc2581612 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:38.872855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec54d63-12c1-4235-aa7e-473cc2581612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:38.874304 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec54d63-12c1-4235-aa7e-473cc2581612 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:38.883448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 375/757] 10.222.0.24 () {56 vars in 1126 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:38.890698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58bdbe-1eca-4388-8b09-5710d5bf06d0 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:39.030796 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58bdbe-1eca-4388-8b09-5710d5bf06d0 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:39.075645 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d13818f-3c66-4462-98c7-523628c5726b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:39.076353 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13818f-3c66-4462-98c7-523628c5726b None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:39.076814 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13818f-3c66-4462-98c7-523628c5726b None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:39.077098 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d13818f-3c66-4462-98c7-523628c5726b None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:39.077849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13818f-3c66-4462-98c7-523628c5726b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:39.078159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13818f-3c66-4462-98c7-523628c5726b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:39.079599 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d13818f-3c66-4462-98c7-523628c5726b None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:39.086025 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 383/758] 10.222.0.24 () {56 vars in 1126 bytes} [Sat Jun 4 20:36:38 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:41.596732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606d2ff-fff6-41bc-9d95-fe43e5db6b9e None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.597327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606d2ff-fff6-41bc-9d95-fe43e5db6b9e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.597706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1606d2ff-fff6-41bc-9d95-fe43e5db6b9e None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.600504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 376/759] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:41.609775 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d01fd-7759-440e-b4f4-d3e3b4f8c4f5 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.610379 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d01fd-7759-440e-b4f4-d3e3b4f8c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.610745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d01fd-7759-440e-b4f4-d3e3b4f8c4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.640278 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-6e3d01fd-7759-440e-b4f4-d3e3b4f8c4f5 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:41.642320 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-6e3d01fd-7759-440e-b4f4-d3e3b4f8c4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:41.723312 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:41.768964 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 384/760] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:41 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:41.809196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606d2ff-fff6-41bc-9d95-fe43e5db6b9e None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:41.880702 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7d4a3-ad3c-4200-a7a6-baff9a28fb66 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.881043 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7d4a3-ad3c-4200-a7a6-baff9a28fb66 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.881442 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7d4a3-ad3c-4200-a7a6-baff9a28fb66 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.883314 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 385/761] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:41.890675 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8d0f5-f9b2-4aa8-9662-98c1d8ff1aa7 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:41.891107 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8d0f5-f9b2-4aa8-9662-98c1d8ff1aa7 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:41.891472 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce8d0f5-f9b2-4aa8-9662-98c1d8ff1aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:41.912117 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-9ce8d0f5-f9b2-4aa8-9662-98c1d8ff1aa7 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:41.913619 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-9ce8d0f5-f9b2-4aa8-9662-98c1d8ff1aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:41.956397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1606d2ff-fff6-41bc-9d95-fe43e5db6b9e None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:42.008886 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 386/762] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:41 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:36:42.011399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8195a7ea-b0cd-40c8-a005-49a6bc3bd24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:42.012195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a7ea-b0cd-40c8-a005-49a6bc3bd24a None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:42.012615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a7ea-b0cd-40c8-a005-49a6bc3bd24a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:42.012957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8195a7ea-b0cd-40c8-a005-49a6bc3bd24a None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:42.014159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195a7ea-b0cd-40c8-a005-49a6bc3bd24a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:42.015769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8195a7ea-b0cd-40c8-a005-49a6bc3bd24a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:42.034928 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 377/763] 10.222.0.24 () {60 vars in 1141 bytes} [Sat Jun 4 20:36:41 2022] POST /identity/v3/services => generated 269 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:42.039709 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8d0f5-f9b2-4aa8-9662-98c1d8ff1aa7 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:42.191704 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce8d0f5-f9b2-4aa8-9662-98c1d8ff1aa7 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:42.201670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:42.246359 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89542a9-cc1d-4faa-ae80-2a5ae548b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:42.248571 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89542a9-cc1d-4faa-ae80-2a5ae548b9b7 None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:42.248571 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89542a9-cc1d-4faa-ae80-2a5ae548b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:42.248571 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89542a9-cc1d-4faa-ae80-2a5ae548b9b7 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:42.248571 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89542a9-cc1d-4faa-ae80-2a5ae548b9b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:42.249845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89542a9-cc1d-4faa-ae80-2a5ae548b9b7 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:42.268672 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 387/764] 10.222.0.24 () {60 vars in 1141 bytes} [Sat Jun 4 20:36:42 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:44.562110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ec309-997b-4c9b-b92d-1de1f03afebf None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.562658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ec309-997b-4c9b-b92d-1de1f03afebf None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.563272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626ec309-997b-4c9b-b92d-1de1f03afebf None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.565919 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 378/765] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:44.574541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ff68c-89ad-47e8-8a67-b073a1955653 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.575128 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ff68c-89ad-47e8-8a67-b073a1955653 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.575128 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01ff68c-89ad-47e8-8a67-b073a1955653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.593732 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-c01ff68c-89ad-47e8-8a67-b073a1955653 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:44.595001 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-c01ff68c-89ad-47e8-8a67-b073a1955653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:44.676462 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 388/766] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:44.700814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ec309-997b-4c9b-b92d-1de1f03afebf None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:44.715935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:44.823030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626ec309-997b-4c9b-b92d-1de1f03afebf None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:44.859401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12c82f-dcb7-4db2-8fbf-495b6b9b255e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:44.860231 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12c82f-dcb7-4db2-8fbf-495b6b9b255e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.860543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12c82f-dcb7-4db2-8fbf-495b6b9b255e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.860820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12c82f-dcb7-4db2-8fbf-495b6b9b255e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.861486 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12c82f-dcb7-4db2-8fbf-495b6b9b255e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:44.862881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12c82f-dcb7-4db2-8fbf-495b6b9b255e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:44.875405 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208098-e062-4765-a9b4-6e0a5d392eed None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.875672 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208098-e062-4765-a9b4-6e0a5d392eed None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.875963 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00208098-e062-4765-a9b4-6e0a5d392eed None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.877421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 389/767] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-2e12c82f-dcb7-4db2-8fbf-495b6b9b255e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:44.877987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:44.879559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:44.881565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 379/768] 10.222.0.24 () {56 vars in 1132 bytes} [Sat Jun 4 20:36:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:44.884598 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1c150-c816-4ee1-982b-e93038a992ce None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:44.884881 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1c150-c816-4ee1-982b-e93038a992ce None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:44.885881 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1c150-c816-4ee1-982b-e93038a992ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:44.888934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12c82f-dcb7-4db2-8fbf-495b6b9b255e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:44.903509 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-d9b1c150-c816-4ee1-982b-e93038a992ce None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:44.904783 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-d9b1c150-c816-4ee1-982b-e93038a992ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:44.983011 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 390/769] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:44.983221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.007784 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1c150-c816-4ee1-982b-e93038a992ce None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.025086 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12c82f-dcb7-4db2-8fbf-495b6b9b255e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.029582 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.064343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89af83d-5333-4f7e-8c80-da1ccad520d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.065061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89af83d-5333-4f7e-8c80-da1ccad520d2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.065342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89af83d-5333-4f7e-8c80-da1ccad520d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.065614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89af83d-5333-4f7e-8c80-da1ccad520d2 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.066356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89af83d-5333-4f7e-8c80-da1ccad520d2 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:45.066724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89af83d-5333-4f7e-8c80-da1ccad520d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.068227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89af83d-5333-4f7e-8c80-da1ccad520d2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.073577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 380/770] 10.222.0.24 () {56 vars in 1126 bytes} [Sat Jun 4 20:36:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:45.079393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89af83d-5333-4f7e-8c80-da1ccad520d2 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.145226 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1c150-c816-4ee1-982b-e93038a992ce None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.189068 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6670a8-b440-48cf-908b-a7d84f1533e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.190145 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6670a8-b440-48cf-908b-a7d84f1533e9 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.190145 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6670a8-b440-48cf-908b-a7d84f1533e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.190443 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6670a8-b440-48cf-908b-a7d84f1533e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.191112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6670a8-b440-48cf-908b-a7d84f1533e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.192627 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6670a8-b440-48cf-908b-a7d84f1533e9 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.199227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89af83d-5333-4f7e-8c80-da1ccad520d2 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-1f6670a8-b440-48cf-908b-a7d84f1533e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:45.205503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:45.206980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:45.208363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 391/771] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:45.213951 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6670a8-b440-48cf-908b-a7d84f1533e9 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.252789 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2db50-6899-48cb-a26c-47d65a989e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.253786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2db50-6899-48cb-a26c-47d65a989e65 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.254197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2db50-6899-48cb-a26c-47d65a989e65 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.254598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2db50-6899-48cb-a26c-47d65a989e65 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.255742 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2db50-6899-48cb-a26c-47d65a989e65 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:45.256210 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2db50-6899-48cb-a26c-47d65a989e65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.258408 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2db50-6899-48cb-a26c-47d65a989e65 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.262129 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.273239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 381/772] 10.222.0.24 () {56 vars in 1126 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:45.275063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2db50-6899-48cb-a26c-47d65a989e65 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.320056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.340480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6670a8-b440-48cf-908b-a7d84f1533e9 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.382456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3450493-f779-487f-88e2-2aa0fa0b187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.383161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450493-f779-487f-88e2-2aa0fa0b187a None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.383444 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450493-f779-487f-88e2-2aa0fa0b187a None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.383724 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3450493-f779-487f-88e2-2aa0fa0b187a None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.384504 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3450493-f779-487f-88e2-2aa0fa0b187a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:45.384822 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3450493-f779-487f-88e2-2aa0fa0b187a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.386213 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3450493-f779-487f-88e2-2aa0fa0b187a None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.391685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2db50-6899-48cb-a26c-47d65a989e65 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.391921 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 392/773] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:45.400148 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3450493-f779-487f-88e2-2aa0fa0b187a None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.434517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a3f0a-d48d-4589-9046-55f61b7fb6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.435197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a3f0a-d48d-4589-9046-55f61b7fb6fa None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.435477 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a3f0a-d48d-4589-9046-55f61b7fb6fa None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.435758 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a3f0a-d48d-4589-9046-55f61b7fb6fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.436598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a3f0a-d48d-4589-9046-55f61b7fb6fa None admin] RBAC: Adding query filter params (interface=public, service_id=ab6643f5896d4a28a74ef800a57db248, region_id=RegionOne) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:45.436953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a3f0a-d48d-4589-9046-55f61b7fb6fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.438343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0a3f0a-d48d-4589-9046-55f61b7fb6fa None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.449842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 382/774] 10.222.0.24 () {56 vars in 1251 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/endpoints?service_id=ab6643f5896d4a28a74ef800a57db248&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:45.451614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a3f0a-d48d-4589-9046-55f61b7fb6fa None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.528341 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.533280 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3450493-f779-487f-88e2-2aa0fa0b187a None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.579784 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f10464-f80f-43f8-9d4e-dde0b29c15ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.580508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a3f0a-d48d-4589-9046-55f61b7fb6fa None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.580893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f10464-f80f-43f8-9d4e-dde0b29c15ae None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.580893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f10464-f80f-43f8-9d4e-dde0b29c15ae None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.581033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f10464-f80f-43f8-9d4e-dde0b29c15ae None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.581745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f10464-f80f-43f8-9d4e-dde0b29c15ae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:45.582056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f10464-f80f-43f8-9d4e-dde0b29c15ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.583796 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f10464-f80f-43f8-9d4e-dde0b29c15ae None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.589871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 393/775] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:45.595863 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f10464-f80f-43f8-9d4e-dde0b29c15ae None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.611460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.629887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1a72-36b2-4be4-a07f-3240620413c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.631150 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1a72-36b2-4be4-a07f-3240620413c3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.631440 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1a72-36b2-4be4-a07f-3240620413c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.631727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d1a72-36b2-4be4-a07f-3240620413c3 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.632443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1a72-36b2-4be4-a07f-3240620413c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.633914 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d1a72-36b2-4be4-a07f-3240620413c3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.640880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 383/776] 10.222.0.24 () {56 vars in 1087 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/services => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:36:45.729581 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f10464-f80f-43f8-9d4e-dde0b29c15ae None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.772669 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50bcce-2d9b-4e84-80eb-55c76d4a73c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.773478 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50bcce-2d9b-4e84-80eb-55c76d4a73c0 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.773659 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50bcce-2d9b-4e84-80eb-55c76d4a73c0 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.773959 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50bcce-2d9b-4e84-80eb-55c76d4a73c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.774748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50bcce-2d9b-4e84-80eb-55c76d4a73c0 None admin] RBAC: Adding query filter params (interface=public, service_id=2e603ef1bbcc4a2f80673feb9a4b4229, region_id=RegionOne) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:45.775057 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50bcce-2d9b-4e84-80eb-55c76d4a73c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.776911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50bcce-2d9b-4e84-80eb-55c76d4a73c0 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.782807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 394/777] 10.222.0.24 () {56 vars in 1251 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/endpoints?service_id=2e603ef1bbcc4a2f80673feb9a4b4229&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:45.789118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1a72-36b2-4be4-a07f-3240620413c3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:45.928530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d1a72-36b2-4be4-a07f-3240620413c3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:45.961133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:45.970988 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9428170-d236-46b1-ae1b-4c4dc34141ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:45.971692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9428170-d236-46b1-ae1b-4c4dc34141ce None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:45.971968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9428170-d236-46b1-ae1b-4c4dc34141ce None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:45.972241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9428170-d236-46b1-ae1b-4c4dc34141ce None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:45.973000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9428170-d236-46b1-ae1b-4c4dc34141ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:45.974577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9428170-d236-46b1-ae1b-4c4dc34141ce None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:45.981754 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 384/778] 10.222.0.24 () {56 vars in 1087 bytes} [Sat Jun 4 20:36:45 2022] GET /identity/v3/services => generated 1498 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:36:48.092884 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071db3-a89f-49bb-96e4-57c4a22e22a3 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.093647 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071db3-a89f-49bb-96e4-57c4a22e22a3 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.093857 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071db3-a89f-49bb-96e4-57c4a22e22a3 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.096503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 395/779] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:48.105753 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa991ad3-1144-454f-a5e1-75467a7f3d3d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.106626 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa991ad3-1144-454f-a5e1-75467a7f3d3d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.106626 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa991ad3-1144-454f-a5e1-75467a7f3d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.125865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-aa991ad3-1144-454f-a5e1-75467a7f3d3d None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:48.127184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-aa991ad3-1144-454f-a5e1-75467a7f3d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:48.206297 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 385/780] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:48 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:48.232366 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2071db3-a89f-49bb-96e4-57c4a22e22a3 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:48.383747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:48.437344 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2071db3-a89f-49bb-96e4-57c4a22e22a3 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:48.500466 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929544e0-86f2-4451-a4f7-f222a7b27976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:48.501745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929544e0-86f2-4451-a4f7-f222a7b27976 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.502191 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929544e0-86f2-4451-a4f7-f222a7b27976 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.502649 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929544e0-86f2-4451-a4f7-f222a7b27976 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.503929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929544e0-86f2-4451-a4f7-f222a7b27976 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:48.506718 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929544e0-86f2-4451-a4f7-f222a7b27976 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-929544e0-86f2-4451-a4f7-f222a7b27976 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:48.533767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:48.534788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 04 20:36:48.535612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:48.537141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600aed-0943-455a-8481-86153abb2b06 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.537141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600aed-0943-455a-8481-86153abb2b06 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.537141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24600aed-0943-455a-8481-86153abb2b06 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.537380 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 396/781] 10.222.0.24 () {56 vars in 1132 bytes} [Sat Jun 4 20:36:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:48.539020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 386/782] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:48.542843 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929544e0-86f2-4451-a4f7-f222a7b27976 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:48.548099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5594-ef22-4a79-9b69-b84a700ef23c None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.548505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5594-ef22-4a79-9b69-b84a700ef23c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.548991 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5594-ef22-4a79-9b69-b84a700ef23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.576017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-ae8c5594-ef22-4a79-9b69-b84a700ef23c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:48.578033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ae8c5594-ef22-4a79-9b69-b84a700ef23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:48.661736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 387/783] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:48 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:36:48.664398 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929544e0-86f2-4451-a4f7-f222a7b27976 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:48.687380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c5594-ef22-4a79-9b69-b84a700ef23c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:48.703186 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f6ff4-f180-4ad0-96a1-cf5404057be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:48.703876 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f6ff4-f180-4ad0-96a1-cf5404057be6 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.704155 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f6ff4-f180-4ad0-96a1-cf5404057be6 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.704461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f6ff4-f180-4ad0-96a1-cf5404057be6 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.705179 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f6ff4-f180-4ad0-96a1-cf5404057be6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:48.705551 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f6ff4-f180-4ad0-96a1-cf5404057be6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:48.706987 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f6ff4-f180-4ad0-96a1-cf5404057be6 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:48.718967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 397/784] 10.222.0.24 () {56 vars in 1126 bytes} [Sat Jun 4 20:36:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:48.721072 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f6ff4-f180-4ad0-96a1-cf5404057be6 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:48.726183 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:48.756318 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:48.834913 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c5594-ef22-4a79-9b69-b84a700ef23c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:48.877480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f6ff4-f180-4ad0-96a1-cf5404057be6 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:48.889460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c126a2-113d-4364-80e8-7c1468f6084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:48.890469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c126a2-113d-4364-80e8-7c1468f6084c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.890854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c126a2-113d-4364-80e8-7c1468f6084c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.891217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c126a2-113d-4364-80e8-7c1468f6084c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.891981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c126a2-113d-4364-80e8-7c1468f6084c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:48.893619 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c126a2-113d-4364-80e8-7c1468f6084c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-24c126a2-113d-4364-80e8-7c1468f6084c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:48.907409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:48.914918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:48.915765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 388/785] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:48.916590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c126a2-113d-4364-80e8-7c1468f6084c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:48.926163 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f49214-e579-4e45-abbb-02c13fd5eefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:48.926932 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49214-e579-4e45-abbb-02c13fd5eefe None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:48.927205 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49214-e579-4e45-abbb-02c13fd5eefe None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:48.927485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f49214-e579-4e45-abbb-02c13fd5eefe None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:48.928391 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f49214-e579-4e45-abbb-02c13fd5eefe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:48.928751 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f49214-e579-4e45-abbb-02c13fd5eefe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:48.930169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f49214-e579-4e45-abbb-02c13fd5eefe None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:48.935792 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 398/786] 10.222.0.24 () {56 vars in 1126 bytes} [Sat Jun 4 20:36:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:48.941952 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f49214-e579-4e45-abbb-02c13fd5eefe None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:49.020236 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:49.069623 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f49214-e579-4e45-abbb-02c13fd5eefe None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:49.099054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c126a2-113d-4364-80e8-7c1468f6084c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:49.115831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a96e3-b0b2-4e89-9eba-f4d9e8e04ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:49.116713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a96e3-b0b2-4e89-9eba-f4d9e8e04ad4 None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:49.116865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a96e3-b0b2-4e89-9eba-f4d9e8e04ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:49.117130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a96e3-b0b2-4e89-9eba-f4d9e8e04ad4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:49.117961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a96e3-b0b2-4e89-9eba-f4d9e8e04ad4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:49.119408 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a96e3-b0b2-4e89-9eba-f4d9e8e04ad4 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:49.127412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:49.152598 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 399/787] 10.222.0.24 () {60 vars in 1144 bytes} [Sat Jun 4 20:36:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:36:49.164907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babdce3-d12f-43d3-8478-0b19fa5884b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:49.165689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babdce3-d12f-43d3-8478-0b19fa5884b4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:49.165921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babdce3-d12f-43d3-8478-0b19fa5884b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:49.166200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babdce3-d12f-43d3-8478-0b19fa5884b4 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:49.166955 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babdce3-d12f-43d3-8478-0b19fa5884b4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:49.167271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babdce3-d12f-43d3-8478-0b19fa5884b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:49.168830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babdce3-d12f-43d3-8478-0b19fa5884b4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:49.174990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 389/788] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:49.181853 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a96e3-b0b2-4e89-9eba-f4d9e8e04ad4 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:49.340643 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a96e3-b0b2-4e89-9eba-f4d9e8e04ad4 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:49.371757 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:49.389239 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a17686-7045-4085-b1ee-ff8062d84574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:49.389942 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17686-7045-4085-b1ee-ff8062d84574 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:49.390226 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17686-7045-4085-b1ee-ff8062d84574 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:49.390500 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a17686-7045-4085-b1ee-ff8062d84574 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:49.391242 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a17686-7045-4085-b1ee-ff8062d84574 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:49.391548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a17686-7045-4085-b1ee-ff8062d84574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:49.393078 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a17686-7045-4085-b1ee-ff8062d84574 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:49.399972 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 400/789] 10.222.0.24 () {56 vars in 1114 bytes} [Sat Jun 4 20:36:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:49.406528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babdce3-d12f-43d3-8478-0b19fa5884b4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:49.542463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babdce3-d12f-43d3-8478-0b19fa5884b4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:49.588486 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89084c7a-bbfd-4fa0-ad49-40f4658e1baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:49.589210 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89084c7a-bbfd-4fa0-ad49-40f4658e1baf None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:49.589494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89084c7a-bbfd-4fa0-ad49-40f4658e1baf None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:49.589771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89084c7a-bbfd-4fa0-ad49-40f4658e1baf None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:49.590558 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89084c7a-bbfd-4fa0-ad49-40f4658e1baf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:49.592010 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89084c7a-bbfd-4fa0-ad49-40f4658e1baf None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:49.619512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 390/790] 10.222.0.24 () {60 vars in 1144 bytes} [Sat Jun 4 20:36:49 2022] POST /identity/v3/endpoints => generated 346 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:36:51.700928 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3e96-15d7-4c81-a235-e04f48c5b268 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.701825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3e96-15d7-4c81-a235-e04f48c5b268 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.701825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f3e96-15d7-4c81-a235-e04f48c5b268 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.702905 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 401/791] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:51.712406 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee1e54-e023-4ffc-bcda-c9c40cb2e40c None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:51.713049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee1e54-e023-4ffc-bcda-c9c40cb2e40c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:51.713403 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee1e54-e023-4ffc-bcda-c9c40cb2e40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:51.744267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-8aee1e54-e023-4ffc-bcda-c9c40cb2e40c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:51.746511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-8aee1e54-e023-4ffc-bcda-c9c40cb2e40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:51.798121 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:51.891276 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 391/792] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:51 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:51.915917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f3e96-15d7-4c81-a235-e04f48c5b268 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.034753 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f3e96-15d7-4c81-a235-e04f48c5b268 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.072030 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d7f38-7abc-498b-ac6c-ae2521217212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.072801 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7f38-7abc-498b-ac6c-ae2521217212 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.073080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7f38-7abc-498b-ac6c-ae2521217212 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.073336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d7f38-7abc-498b-ac6c-ae2521217212 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.073996 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d7f38-7abc-498b-ac6c-ae2521217212 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.075369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880d7f38-7abc-498b-ac6c-ae2521217212 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-880d7f38-7abc-498b-ac6c-ae2521217212 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:52.087745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:52.089084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:52.089975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 402/793] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:52.095404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee1e54-e023-4ffc-bcda-c9c40cb2e40c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.213145 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509bcdf-e670-486e-9162-716f8050d56f None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.213453 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509bcdf-e670-486e-9162-716f8050d56f None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.213732 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509bcdf-e670-486e-9162-716f8050d56f None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.215137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 403/794] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:36:52.222901 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628470b-c1d3-4044-b2bf-9e58cc139fd3 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.222901 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628470b-c1d3-4044-b2bf-9e58cc139fd3 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.223463 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628470b-c1d3-4044-b2bf-9e58cc139fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.228001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee1e54-e023-4ffc-bcda-c9c40cb2e40c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.241481 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-6628470b-c1d3-4044-b2bf-9e58cc139fd3 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:52.242706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-6628470b-c1d3-4044-b2bf-9e58cc139fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:52.269052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612340b-4651-47e6-9b3b-a84edae7e22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.269732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612340b-4651-47e6-9b3b-a84edae7e22d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.270095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612340b-4651-47e6-9b3b-a84edae7e22d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.270425 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1612340b-4651-47e6-9b3b-a84edae7e22d None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.271177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612340b-4651-47e6-9b3b-a84edae7e22d None admin] RBAC: Adding query filter params (name=compute) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:52.271725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612340b-4651-47e6-9b3b-a84edae7e22d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.272894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1612340b-4651-47e6-9b3b-a84edae7e22d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.278818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 392/795] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:52.284405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612340b-4651-47e6-9b3b-a84edae7e22d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.299135 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:52.325363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:52.328684 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 404/796] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:52 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:36:52.353455 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628470b-c1d3-4044-b2bf-9e58cc139fd3 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.413902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1612340b-4651-47e6-9b3b-a84edae7e22d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.458421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a72f8b-9b21-489d-aa43-82d36095ecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.459536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a72f8b-9b21-489d-aa43-82d36095ecd9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.460031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a72f8b-9b21-489d-aa43-82d36095ecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.460478 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a72f8b-9b21-489d-aa43-82d36095ecd9 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.461806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a72f8b-9b21-489d-aa43-82d36095ecd9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:52.462375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a72f8b-9b21-489d-aa43-82d36095ecd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.465037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a72f8b-9b21-489d-aa43-82d36095ecd9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.473513 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 393/797] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:36:52.497159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628470b-c1d3-4044-b2bf-9e58cc139fd3 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.542310 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81055cb1-d642-49dd-b563-cc8b58064b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.543002 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055cb1-d642-49dd-b563-cc8b58064b4c None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.543290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055cb1-d642-49dd-b563-cc8b58064b4c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.543566 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81055cb1-d642-49dd-b563-cc8b58064b4c None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.544345 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81055cb1-d642-49dd-b563-cc8b58064b4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.545972 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81055cb1-d642-49dd-b563-cc8b58064b4c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.547514 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: WARNING keystone.server.flask.common [None req-81055cb1-d642-49dd-b563-cc8b58064b4c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 04 20:36:52.570979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.sql.core [None req-81055cb1-d642-49dd-b563-cc8b58064b4c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 20:36:52.570979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 20:36:52.570979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [parameters: {'id': '333b4ebc05af462b984f284f0e8a6369', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 04 20:36:52.570979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98932) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-81055cb1-d642-49dd-b563-cc8b58064b4c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 333b4ebc05af462b984f284f0e8a6369.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 333b4ebc05af462b984f284f0e8a6369. Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application conn.query(q) Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:36:52.596859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application result.read() Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 04 20:36:52.597788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application next(self.gen) Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application yield resource Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application next(self.gen) Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise self.value Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application session.commit() Jun 04 20:36:52.598978 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self.session.flush() Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application compat.raise_( Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 20:36:52.600080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 20:36:52.601091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application conn.query(q) Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application result.read() Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:36:52.602146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [parameters: {'id': '333b4ebc05af462b984f284f0e8a6369', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:52.603613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:52.607206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:52.610373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:52.610373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 04 20:36:52.610373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 04 20:36:52.610373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:52.610373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:52.610373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 04 20:36:52.610373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 04 20:36:52.610373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 333b4ebc05af462b984f284f0e8a6369. Jun 04 20:36:52.610373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:52.610373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 405/798] 10.222.0.24 () {60 vars in 1140 bytes} [Sat Jun 4 20:36:52 2022] POST /identity/v3/projects => generated 262 bytes in 245 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:52.612178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a72f8b-9b21-489d-aa43-82d36095ecd9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.719931 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:52.743539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a72f8b-9b21-489d-aa43-82d36095ecd9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:52.785497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b68df-9330-4e6c-a1b2-00aad6dcdf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:52.786460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b68df-9330-4e6c-a1b2-00aad6dcdf64 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:52.786994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b68df-9330-4e6c-a1b2-00aad6dcdf64 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:52.787356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b68df-9330-4e6c-a1b2-00aad6dcdf64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:52.795495 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b68df-9330-4e6c-a1b2-00aad6dcdf64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:52.797034 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b68df-9330-4e6c-a1b2-00aad6dcdf64 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-ac1b68df-9330-4e6c-a1b2-00aad6dcdf64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:36:52.812104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:52.813268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:52.814184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:36:52.814184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:36:52.814184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:36:52.814184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:36:52.814184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:36:52.814184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:36:52.814184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:36:52.814184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:52.814184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 394/799] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:52.824655 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81055cb1-d642-49dd-b563-cc8b58064b4c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:52.886648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:52.964090 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81055cb1-d642-49dd-b563-cc8b58064b4c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:53.002535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c27a44-7495-42cf-bbd8-6184f845ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:53.003284 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c27a44-7495-42cf-bbd8-6184f845ea18 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:53.003542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c27a44-7495-42cf-bbd8-6184f845ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:53.003762 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c27a44-7495-42cf-bbd8-6184f845ea18 None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:53.004644 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c27a44-7495-42cf-bbd8-6184f845ea18 None admin] RBAC: Adding query filter params (name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:53.004953 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c27a44-7495-42cf-bbd8-6184f845ea18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:53.006664 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c27a44-7495-42cf-bbd8-6184f845ea18 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:53.033104 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 406/800] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:36:52 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:54.937789 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4396c62-b370-4295-b401-c825bce125e6 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:54.938412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4396c62-b370-4295-b401-c825bce125e6 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:54.938729 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4396c62-b370-4295-b401-c825bce125e6 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:54.941353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 395/801] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:54.951594 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7614f4e-8ca3-4e26-a79d-5f9b125f8878 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:54.952182 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7614f4e-8ca3-4e26-a79d-5f9b125f8878 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:54.952395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7614f4e-8ca3-4e26-a79d-5f9b125f8878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:54.974440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-e7614f4e-8ca3-4e26-a79d-5f9b125f8878 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:54.976035 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-e7614f4e-8ca3-4e26-a79d-5f9b125f8878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:55.069465 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 407/802] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:54 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:55.094225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4396c62-b370-4295-b401-c825bce125e6 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:55.222289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4396c62-b370-4295-b401-c825bce125e6 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:55.266854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90c30f-c0e0-4bf1-bf82-1a0de1610f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:55.267556 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90c30f-c0e0-4bf1-bf82-1a0de1610f3a None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.267839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90c30f-c0e0-4bf1-bf82-1a0de1610f3a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.268115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90c30f-c0e0-4bf1-bf82-1a0de1610f3a None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.268938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90c30f-c0e0-4bf1-bf82-1a0de1610f3a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:55.271206 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90c30f-c0e0-4bf1-bf82-1a0de1610f3a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:55.294871 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 396/803] 10.222.0.24 () {60 vars in 1141 bytes} [Sat Jun 4 20:36:55 2022] POST /identity/v3/services => generated 242 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:36:55.477598 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7af83-88c1-421a-b4cf-b39e18378d8d None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.477994 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7af83-88c1-421a-b4cf-b39e18378d8d None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.478489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7af83-88c1-421a-b4cf-b39e18378d8d None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.481337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 408/804] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:55.490319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8866-3353-4ba5-97ab-196ba74f4177 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.490759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8866-3353-4ba5-97ab-196ba74f4177 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.491150 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8866-3353-4ba5-97ab-196ba74f4177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.506539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:55.517161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-18ca8866-3353-4ba5-97ab-196ba74f4177 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:55.518968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-18ca8866-3353-4ba5-97ab-196ba74f4177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:55.627831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 397/805] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:55 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:55.655789 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7af83-88c1-421a-b4cf-b39e18378d8d None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:55.689015 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:55.780639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7af83-88c1-421a-b4cf-b39e18378d8d None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:55.823202 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d3491-0c84-4f12-958e-4d00f3b08b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:55.824032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d3491-0c84-4f12-958e-4d00f3b08b46 None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:55.824374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d3491-0c84-4f12-958e-4d00f3b08b46 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:55.824745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d3491-0c84-4f12-958e-4d00f3b08b46 None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:55.825536 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d3491-0c84-4f12-958e-4d00f3b08b46 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:55.827460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d3491-0c84-4f12-958e-4d00f3b08b46 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:55.846404 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.sql.core [None req-957d3491-0c84-4f12-958e-4d00f3b08b46 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 20:36:55.846404 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 04 20:36:55.846404 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [parameters: {'user_id': '2b17968f176a43a38fad7ea3fc7d0282', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 04 20:36:55.846404 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98932) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-957d3491-0c84-4f12-958e-4d00f3b08b46 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application conn.query(q) Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application result.read() Jun 04 20:36:55.854983 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 20:36:55.856793 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application next(self.gen) Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application yield resource Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application next(self.gen) Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self.session.rollback() Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self.force_reraise() Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise self.value Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application session.commit() Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 04 20:36:55.858642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._prepare_impl() Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self.session.flush() Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._flush(objects) Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application compat.raise_( Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application flush_context.execute() Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rec.execute(self) Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 04 20:36:55.860350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 04 20:36:55.862056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application result = self._query(query) Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application conn.query(q) Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application result.read() Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 04 20:36:55.863691 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [parameters: {'user_id': '2b17968f176a43a38fad7ea3fc7d0282', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:55.867471 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 04 20:36:55.870858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 04 20:36:55.872967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 04 20:36:55.872967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 04 20:36:55.872967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 04 20:36:55.872967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 04 20:36:55.872967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 04 20:36:55.872967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:36:55.872967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 409/806] 10.222.0.24 () {60 vars in 1131 bytes} [Sat Jun 4 20:36:55 2022] POST /identity/v3/users => generated 160 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:55.873833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8866-3353-4ba5-97ab-196ba74f4177 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.001934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8866-3353-4ba5-97ab-196ba74f4177 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:56.034713 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:56.041367 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ef44e-e21e-4513-991d-4bc13ea06f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.042224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ef44e-e21e-4513-991d-4bc13ea06f29 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.042505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ef44e-e21e-4513-991d-4bc13ea06f29 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.042824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ef44e-e21e-4513-991d-4bc13ea06f29 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.051824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ef44e-e21e-4513-991d-4bc13ea06f29 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.053784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ef44e-e21e-4513-991d-4bc13ea06f29 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-ce6ef44e-e21e-4513-991d-4bc13ea06f29 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:36:56.070801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:56.072814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:56.075119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:56.075119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:56.075119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:36:56.075119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:36:56.075119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:36:56.075119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:36:56.075119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:36:56.075119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:36:56.075119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 04 20:36:56.075119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:56.075119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 398/807] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:36:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:36:56.080670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d3491-0c84-4f12-958e-4d00f3b08b46 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:56.189821 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:56.206173 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d3491-0c84-4f12-958e-4d00f3b08b46 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:56.247852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff034d-c304-4956-ad2c-4b7b40f58fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:56.248574 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff034d-c304-4956-ad2c-4b7b40f58fe4 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:56.248859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff034d-c304-4956-ad2c-4b7b40f58fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:56.249135 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff034d-c304-4956-ad2c-4b7b40f58fe4 None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:56.249974 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff034d-c304-4956-ad2c-4b7b40f58fe4 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:56.250284 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff034d-c304-4956-ad2c-4b7b40f58fe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:56.251996 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff034d-c304-4956-ad2c-4b7b40f58fe4 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:56.299389 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 410/808] 10.222.0.24 () {56 vars in 1101 bytes} [Sat Jun 4 20:36:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:57.826220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896a66-6817-4738-befd-45d840dea341 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:57.826768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896a66-6817-4738-befd-45d840dea341 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:57.826768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31896a66-6817-4738-befd-45d840dea341 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:57.828108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 399/809] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:36:57.834474 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d5ef6-8512-4173-96e8-2a46bfdcea68 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:57.835041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d5ef6-8512-4173-96e8-2a46bfdcea68 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:57.835169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d5ef6-8512-4173-96e8-2a46bfdcea68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:57.854082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-dc2d5ef6-8512-4173-96e8-2a46bfdcea68 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:36:57.855686 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-dc2d5ef6-8512-4173-96e8-2a46bfdcea68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:36:57.932234 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 411/810] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:36:57 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:36:57.956651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31896a66-6817-4738-befd-45d840dea341 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.076974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31896a66-6817-4738-befd-45d840dea341 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.115534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce655b-cf40-49dc-89ab-2e6d9d196b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.116414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce655b-cf40-49dc-89ab-2e6d9d196b98 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.116791 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce655b-cf40-49dc-89ab-2e6d9d196b98 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.117151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce655b-cf40-49dc-89ab-2e6d9d196b98 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.117911 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce655b-cf40-49dc-89ab-2e6d9d196b98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.119382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ce655b-cf40-49dc-89ab-2e6d9d196b98 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-99ce655b-cf40-49dc-89ab-2e6d9d196b98 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:36:58.133009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:36:58.134449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:36:58.135484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 400/811] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:36:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:36:58.141873 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d5ef6-8512-4173-96e8-2a46bfdcea68 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.229581 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:58.256547 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d5ef6-8512-4173-96e8-2a46bfdcea68 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.302570 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950b858-35ce-424b-801c-896fcab0c0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.303685 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950b858-35ce-424b-801c-896fcab0c0d9 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.304163 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950b858-35ce-424b-801c-896fcab0c0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.304677 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c950b858-35ce-424b-801c-896fcab0c0d9 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.305998 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950b858-35ce-424b-801c-896fcab0c0d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:58.306522 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950b858-35ce-424b-801c-896fcab0c0d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.309134 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c950b858-35ce-424b-801c-896fcab0c0d9 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.318658 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 412/812] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:58.324858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce655b-cf40-49dc-89ab-2e6d9d196b98 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.392774 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:58.442985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ce655b-cf40-49dc-89ab-2e6d9d196b98 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.483107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d8fbc-49f1-4b5a-b962-b4c1acf80b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.483785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d8fbc-49f1-4b5a-b962-b4c1acf80b83 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.484070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d8fbc-49f1-4b5a-b962-b4c1acf80b83 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.484346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d8fbc-49f1-4b5a-b962-b4c1acf80b83 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.485107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d8fbc-49f1-4b5a-b962-b4c1acf80b83 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:58.485420 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d8fbc-49f1-4b5a-b962-b4c1acf80b83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.486825 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d8fbc-49f1-4b5a-b962-b4c1acf80b83 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.492804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 401/813] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:58.499283 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950b858-35ce-424b-801c-896fcab0c0d9 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.609597 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c950b858-35ce-424b-801c-896fcab0c0d9 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.649941 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320567fe-5ea6-49a4-b0f7-3c3f374281f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.650521 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320567fe-5ea6-49a4-b0f7-3c3f374281f7 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.650804 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320567fe-5ea6-49a4-b0f7-3c3f374281f7 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.651080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320567fe-5ea6-49a4-b0f7-3c3f374281f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.651883 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320567fe-5ea6-49a4-b0f7-3c3f374281f7 None admin] RBAC: Adding query filter params (interface=public, service_id=7b97d1825902446b9ddc6475bb716943, region_id=RegionOne) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:36:58.652227 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320567fe-5ea6-49a4-b0f7-3c3f374281f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.653696 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320567fe-5ea6-49a4-b0f7-3c3f374281f7 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.659493 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 413/814] 10.222.0.24 () {56 vars in 1251 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/endpoints?service_id=7b97d1825902446b9ddc6475bb716943&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:36:58.665881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d8fbc-49f1-4b5a-b962-b4c1acf80b83 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:36:58.783039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d8fbc-49f1-4b5a-b962-b4c1acf80b83 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:36:58.806134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:36:58.822585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bbf0fe-cf03-4167-819c-f0285402295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:36:58.823375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbf0fe-cf03-4167-819c-f0285402295b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:36:58.823767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbf0fe-cf03-4167-819c-f0285402295b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:36:58.824128 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bbf0fe-cf03-4167-819c-f0285402295b None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:36:58.824969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbf0fe-cf03-4167-819c-f0285402295b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:36:58.826453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bbf0fe-cf03-4167-819c-f0285402295b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:36:58.833836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 402/815] 10.222.0.24 () {56 vars in 1087 bytes} [Sat Jun 4 20:36:58 2022] GET /identity/v3/services => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:37:01.295033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900011e1-d685-4480-8696-cbdfdbe16fe2 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:01.295598 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900011e1-d685-4480-8696-cbdfdbe16fe2 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:01.295739 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900011e1-d685-4480-8696-cbdfdbe16fe2 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:01.297217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 414/816] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:37:01.303833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc345-642c-4f00-9c9b-3bfb114f9c5a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:01.304473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc345-642c-4f00-9c9b-3bfb114f9c5a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:01.304473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370bc345-642c-4f00-9c9b-3bfb114f9c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:01.324082 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-370bc345-642c-4f00-9c9b-3bfb114f9c5a None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:37:01.325380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-370bc345-642c-4f00-9c9b-3bfb114f9c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:37:01.410832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 403/817] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:37:01 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:37:01.435819 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900011e1-d685-4480-8696-cbdfdbe16fe2 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:01.440644 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:01.561023 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900011e1-d685-4480-8696-cbdfdbe16fe2 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:01.600114 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512be95-121e-4a3d-9d7f-ab60ec5b6d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:01.600992 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512be95-121e-4a3d-9d7f-ab60ec5b6d5e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:01.601282 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512be95-121e-4a3d-9d7f-ab60ec5b6d5e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:01.601564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512be95-121e-4a3d-9d7f-ab60ec5b6d5e None admin] PATH_INFO: `/v3/services/compute` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:01.602258 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512be95-121e-4a3d-9d7f-ab60ec5b6d5e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:01.603729 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512be95-121e-4a3d-9d7f-ab60ec5b6d5e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-e512be95-121e-4a3d-9d7f-ab60ec5b6d5e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:37:01.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:37:01.618961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:37:01.619852 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 415/818] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:37:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:37:01.629037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bc345-642c-4f00-9c9b-3bfb114f9c5a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:01.806886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370bc345-642c-4f00-9c9b-3bfb114f9c5a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:01.834386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:01.868699 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514df1d6-9673-4401-a95c-35b118e0601d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:01.869383 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514df1d6-9673-4401-a95c-35b118e0601d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:01.869670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514df1d6-9673-4401-a95c-35b118e0601d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:01.870137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514df1d6-9673-4401-a95c-35b118e0601d None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:01.870870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514df1d6-9673-4401-a95c-35b118e0601d None admin] RBAC: Adding query filter params (name=compute) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:01.871179 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514df1d6-9673-4401-a95c-35b118e0601d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:01.872617 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514df1d6-9673-4401-a95c-35b118e0601d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:01.878136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 404/819] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:01.884692 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512be95-121e-4a3d-9d7f-ab60ec5b6d5e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:01.968378 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:02.007422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512be95-121e-4a3d-9d7f-ab60ec5b6d5e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:02.045130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c56e5e-af7a-4830-963d-96fdbe6cf8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:02.045875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56e5e-af7a-4830-963d-96fdbe6cf8ce None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:02.046213 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56e5e-af7a-4830-963d-96fdbe6cf8ce None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:02.046537 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c56e5e-af7a-4830-963d-96fdbe6cf8ce None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:02.047449 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c56e5e-af7a-4830-963d-96fdbe6cf8ce None admin] RBAC: Adding query filter params (type=compute) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:37:02.047806 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c56e5e-af7a-4830-963d-96fdbe6cf8ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:02.049303 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c56e5e-af7a-4830-963d-96fdbe6cf8ce None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:02.055805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 416/820] 10.222.0.24 () {56 vars in 1112 bytes} [Sat Jun 4 20:37:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:37:02.061980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514df1d6-9673-4401-a95c-35b118e0601d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:37:02.172204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514df1d6-9673-4401-a95c-35b118e0601d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:37:02.213199 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb41f1-17c0-414a-98e2-09aa938cb9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:37:02.214073 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb41f1-17c0-414a-98e2-09aa938cb9e4 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:37:02.214365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb41f1-17c0-414a-98e2-09aa938cb9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:37:02.214647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb41f1-17c0-414a-98e2-09aa938cb9e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:37:02.215434 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb41f1-17c0-414a-98e2-09aa938cb9e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:37:02.216925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb41f1-17c0-414a-98e2-09aa938cb9e4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:37:02.239241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 405/821] 10.222.0.24 () {60 vars in 1144 bytes} [Sat Jun 4 20:37:02 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:37:12.053015 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=34 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:37:12.234239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=82,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:08.524155 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42822-c335-4021-b90a-15cb292cc47c None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:08.524966 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42822-c335-4021-b90a-15cb292cc47c None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:08.524966 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a42822-c335-4021-b90a-15cb292cc47c None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:08.526146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 417/822] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:08.532882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52fba-9feb-44ba-b989-bc16ad2965c4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:08.533561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52fba-9feb-44ba-b989-bc16ad2965c4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:08.533561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac52fba-9feb-44ba-b989-bc16ad2965c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:08.553865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-aac52fba-9feb-44ba-b989-bc16ad2965c4 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:08.555082 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-aac52fba-9feb-44ba-b989-bc16ad2965c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:08.648209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 406/823] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:08 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:38:08.678091 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a42822-c335-4021-b90a-15cb292cc47c None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:08.811620 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a42822-c335-4021-b90a-15cb292cc47c None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:08.855274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf14b9-1d05-4364-af09-7c1e63d80306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:08.856229 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf14b9-1d05-4364-af09-7c1e63d80306 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:08.856620 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf14b9-1d05-4364-af09-7c1e63d80306 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:08.856960 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf14b9-1d05-4364-af09-7c1e63d80306 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:08.871765 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf14b9-1d05-4364-af09-7c1e63d80306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:08.873475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf14b9-1d05-4364-af09-7c1e63d80306 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-73cf14b9-1d05-4364-af09-7c1e63d80306 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:08.894967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:08.896097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:08.897207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:08.897207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:08.897207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:08.897207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:08.897207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 418/824] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:38:08.903189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac52fba-9feb-44ba-b989-bc16ad2965c4 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:09.036914 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac52fba-9feb-44ba-b989-bc16ad2965c4 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:09.086063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:09.096986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb516b-49fb-44a4-b71c-c78c2c39c81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:09.098085 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb516b-49fb-44a4-b71c-c78c2c39c81c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:09.098571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb516b-49fb-44a4-b71c-c78c2c39c81c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:09.098866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb516b-49fb-44a4-b71c-c78c2c39c81c None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:09.099775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb516b-49fb-44a4-b71c-c78c2c39c81c None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:09.100089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb516b-49fb-44a4-b71c-c78c2c39c81c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:09.101809 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb516b-49fb-44a4-b71c-c78c2c39c81c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:09.116327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 407/825] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:09.122487 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf14b9-1d05-4364-af09-7c1e63d80306 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:09.193217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:09.278257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf14b9-1d05-4364-af09-7c1e63d80306 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:09.331912 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d30994-da7d-4240-b57f-d4eb3fa81cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:09.332799 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30994-da7d-4240-b57f-d4eb3fa81cda None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:09.333146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30994-da7d-4240-b57f-d4eb3fa81cda None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:09.333494 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d30994-da7d-4240-b57f-d4eb3fa81cda None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:09.334407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d30994-da7d-4240-b57f-d4eb3fa81cda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:09.336277 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d30994-da7d-4240-b57f-d4eb3fa81cda None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:09.366913 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 419/826] 10.222.0.24 () {60 vars in 1132 bytes} [Sat Jun 4 20:38:09 2022] POST /identity/v3/users => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:38:12.093745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c101-2d8f-47d2-9197-e8ff8db5b930 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:12.094343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c101-2d8f-47d2-9197-e8ff8db5b930 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:12.094447 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2c101-2d8f-47d2-9197-e8ff8db5b930 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:12.095801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 408/827] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:12.101461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73588e73-7ea2-4fb5-8f7c-b160535998a6 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:12.102070 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73588e73-7ea2-4fb5-8f7c-b160535998a6 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:12.102070 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73588e73-7ea2-4fb5-8f7c-b160535998a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:12.121032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-73588e73-7ea2-4fb5-8f7c-b160535998a6 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:12.122477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-73588e73-7ea2-4fb5-8f7c-b160535998a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:12.206430 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 420/828] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:12 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:12.233754 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2c101-2d8f-47d2-9197-e8ff8db5b930 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:12.355851 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2c101-2d8f-47d2-9197-e8ff8db5b930 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:12.394426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44d6fa-7a8f-480a-96da-382bf0ea0853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:12.395247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44d6fa-7a8f-480a-96da-382bf0ea0853 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:12.395531 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44d6fa-7a8f-480a-96da-382bf0ea0853 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:12.395806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44d6fa-7a8f-480a-96da-382bf0ea0853 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:12.407805 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b44d6fa-7a8f-480a-96da-382bf0ea0853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-0b44d6fa-7a8f-480a-96da-382bf0ea0853 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:12.415836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:12.417222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:12.418437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 409/829] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:38:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:12.424030 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73588e73-7ea2-4fb5-8f7c-b160535998a6 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:12.465593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:12.539911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73588e73-7ea2-4fb5-8f7c-b160535998a6 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:12.576518 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a41a93-7fc8-44ee-8ebe-31616fa33047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:12.577202 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a41a93-7fc8-44ee-8ebe-31616fa33047 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:12.577484 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a41a93-7fc8-44ee-8ebe-31616fa33047 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:12.577754 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a41a93-7fc8-44ee-8ebe-31616fa33047 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:12.578509 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a41a93-7fc8-44ee-8ebe-31616fa33047 None admin] RBAC: Adding query filter params (name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:12.578935 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a41a93-7fc8-44ee-8ebe-31616fa33047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:12.580387 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a41a93-7fc8-44ee-8ebe-31616fa33047 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:12.589762 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 421/830] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:38:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:12.595735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44d6fa-7a8f-480a-96da-382bf0ea0853 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:12.649605 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:12.717243 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b44d6fa-7a8f-480a-96da-382bf0ea0853 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:12.756270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a24385-99d1-43d3-b3b1-72336680d6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:12.757103 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a24385-99d1-43d3-b3b1-72336680d6a6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:12.757384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a24385-99d1-43d3-b3b1-72336680d6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:12.757695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a24385-99d1-43d3-b3b1-72336680d6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:12.770169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a24385-99d1-43d3-b3b1-72336680d6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:12.771905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a24385-99d1-43d3-b3b1-72336680d6a6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-44a24385-99d1-43d3-b3b1-72336680d6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:12.790982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:12.792290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:12.793290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:12.793290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:12.793290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:12.793290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:12.793290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 410/831] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:12.798417 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a41a93-7fc8-44ee-8ebe-31616fa33047 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:12.915911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:12.920055 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a41a93-7fc8-44ee-8ebe-31616fa33047 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:12.959021 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0655c-fbe1-4061-a510-b4e5a1799eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:12.959801 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0655c-fbe1-4061-a510-b4e5a1799eb5 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:12.960088 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0655c-fbe1-4061-a510-b4e5a1799eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:12.960365 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0655c-fbe1-4061-a510-b4e5a1799eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:12.961132 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0655c-fbe1-4061-a510-b4e5a1799eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:12.961441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0655c-fbe1-4061-a510-b4e5a1799eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:12.962846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c0655c-fbe1-4061-a510-b4e5a1799eb5 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:12.976501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 422/832] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:12.982317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a24385-99d1-43d3-b3b1-72336680d6a6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:13.100481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:13.104900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a24385-99d1-43d3-b3b1-72336680d6a6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:13.146926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2113277-3784-4f82-9a73-9602bcc52a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:13.147899 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2113277-3784-4f82-9a73-9602bcc52a3e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:13.148214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2113277-3784-4f82-9a73-9602bcc52a3e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:13.148592 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2113277-3784-4f82-9a73-9602bcc52a3e None admin] PATH_INFO: `/v3/users/placement` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:13.158073 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2113277-3784-4f82-9a73-9602bcc52a3e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:13.159709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2113277-3784-4f82-9a73-9602bcc52a3e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-d2113277-3784-4f82-9a73-9602bcc52a3e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:38:13.176651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:13.177700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:13.178942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:13.178942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:13.178942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:38:13.178942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:38:13.178942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:38:13.178942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:38:13.178942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:38:13.178942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:38:13.178942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:13.178942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:13.178942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 411/833] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:38:13.184599 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0655c-fbe1-4061-a510-b4e5a1799eb5 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:13.303253 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0655c-fbe1-4061-a510-b4e5a1799eb5 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:13.339782 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9e9a3-551c-445e-a225-c488654e7497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:13.340483 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e9a3-551c-445e-a225-c488654e7497 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:13.340870 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e9a3-551c-445e-a225-c488654e7497 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:13.341031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d9e9a3-551c-445e-a225-c488654e7497 None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:13.341869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9e9a3-551c-445e-a225-c488654e7497 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:13.342177 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9e9a3-551c-445e-a225-c488654e7497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:13.343849 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d9e9a3-551c-445e-a225-c488654e7497 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:13.362730 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 423/834] 10.222.0.24 () {56 vars in 1143 bytes} [Sat Jun 4 20:38:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:13.368866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2113277-3784-4f82-9a73-9602bcc52a3e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:13.479015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2113277-3784-4f82-9a73-9602bcc52a3e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:13.520119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf1f0-2b7c-4c59-820c-0aa3a61a3f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:13.520976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf1f0-2b7c-4c59-820c-0aa3a61a3f25 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:13.521177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf1f0-2b7c-4c59-820c-0aa3a61a3f25 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:13.521382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf1f0-2b7c-4c59-820c-0aa3a61a3f25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:13.553995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:13.601523 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf1f0-2b7c-4c59-820c-0aa3a61a3f25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:13.603175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf1f0-2b7c-4c59-820c-0aa3a61a3f25 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:13.721804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 412/835] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:38:13 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 04 20:38:13.728130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9e9a3-551c-445e-a225-c488654e7497 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:13.748133 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:13.846226 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d9e9a3-551c-445e-a225-c488654e7497 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:13.883958 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a1595-20ab-4120-9b33-46bf3d7d7588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:13.884842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1595-20ab-4120-9b33-46bf3d7d7588 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:13.885112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1595-20ab-4120-9b33-46bf3d7d7588 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:13.885373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a1595-20ab-4120-9b33-46bf3d7d7588 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:13.899000 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a1595-20ab-4120-9b33-46bf3d7d7588 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:13.900545 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3a1595-20ab-4120-9b33-46bf3d7d7588 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-7a3a1595-20ab-4120-9b33-46bf3d7d7588 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:13.921290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:13.922564 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:13.929031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:13.929031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:13.929031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:13.929031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:13.929031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 424/836] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:13.929526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf1f0-2b7c-4c59-820c-0aa3a61a3f25 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:13.996151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:14.046125 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf1f0-2b7c-4c59-820c-0aa3a61a3f25 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:14.087394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d945c7-a777-48cb-9667-da833d2ede17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:14.088079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d945c7-a777-48cb-9667-da833d2ede17 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:14.088379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d945c7-a777-48cb-9667-da833d2ede17 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:14.088689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d945c7-a777-48cb-9667-da833d2ede17 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:14.089476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d945c7-a777-48cb-9667-da833d2ede17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:14.089807 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d945c7-a777-48cb-9667-da833d2ede17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:14.091189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d945c7-a777-48cb-9667-da833d2ede17 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:14.103879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 413/837] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:14.109634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a1595-20ab-4120-9b33-46bf3d7d7588 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:14.193131 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:14.226999 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a1595-20ab-4120-9b33-46bf3d7d7588 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:14.271050 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe990cb-7313-41c6-ad45-4a7369c3dbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:14.271853 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe990cb-7313-41c6-ad45-4a7369c3dbb1 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:14.272140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe990cb-7313-41c6-ad45-4a7369c3dbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:14.272482 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe990cb-7313-41c6-ad45-4a7369c3dbb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:14.281273 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe990cb-7313-41c6-ad45-4a7369c3dbb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:14.282816 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe990cb-7313-41c6-ad45-4a7369c3dbb1 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-7fe990cb-7313-41c6-ad45-4a7369c3dbb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:38:14.297052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:14.298339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:14.299395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:38:14.299395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:38:14.299395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:38:14.299395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:38:14.299395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:38:14.299395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:38:14.299395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:14.299395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:14.299395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 425/838] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:38:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:14.308265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d945c7-a777-48cb-9667-da833d2ede17 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:14.435918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d945c7-a777-48cb-9667-da833d2ede17 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:14.458436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:14.480411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3fb574-10b6-4b99-b11d-0fd65b3758ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:14.481211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb574-10b6-4b99-b11d-0fd65b3758ab None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:14.481541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb574-10b6-4b99-b11d-0fd65b3758ab None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:14.481844 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fb574-10b6-4b99-b11d-0fd65b3758ab None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:14.482682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fb574-10b6-4b99-b11d-0fd65b3758ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:14.482993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fb574-10b6-4b99-b11d-0fd65b3758ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:14.486629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3fb574-10b6-4b99-b11d-0fd65b3758ab None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:14.499793 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 414/839] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:38:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:14.506990 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe990cb-7313-41c6-ad45-4a7369c3dbb1 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:14.624208 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe990cb-7313-41c6-ad45-4a7369c3dbb1 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:14.665333 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:14.670058 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fd276-1f10-4ebc-b42b-69858532a526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:14.670842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd276-1f10-4ebc-b42b-69858532a526 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:14.671492 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd276-1f10-4ebc-b42b-69858532a526 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:14.672165 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd276-1f10-4ebc-b42b-69858532a526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:14.673212 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fd276-1f10-4ebc-b42b-69858532a526 None admin] RBAC: Adding query filter params (role.id=b3da02096234495595b953977e8296d3, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=22f68848269a453289f64d57415fcee5) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:14.673573 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fd276-1f10-4ebc-b42b-69858532a526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:14.675316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fd276-1f10-4ebc-b42b-69858532a526 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:14.682314 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 426/840] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:38:14 2022] GET /identity/v3/role_assignments?user.id=22f68848269a453289f64d57415fcee5&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=b3da02096234495595b953977e8296d3 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:17.130281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68109e69-f90b-4d87-bb68-fa4f029f77bc None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:17.130854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68109e69-f90b-4d87-bb68-fa4f029f77bc None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:17.130854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68109e69-f90b-4d87-bb68-fa4f029f77bc None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:17.132228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 415/841] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:17.138099 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e117221-b9e9-4177-a2d9-a8c56a7525c8 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:17.138568 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e117221-b9e9-4177-a2d9-a8c56a7525c8 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:17.138656 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e117221-b9e9-4177-a2d9-a8c56a7525c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:17.156975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-4e117221-b9e9-4177-a2d9-a8c56a7525c8 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:17.158663 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-4e117221-b9e9-4177-a2d9-a8c56a7525c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:17.241102 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 427/842] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:17 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:17.269837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68109e69-f90b-4d87-bb68-fa4f029f77bc None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:17.388855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68109e69-f90b-4d87-bb68-fa4f029f77bc None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:17.431623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76139bed-d031-4396-86c1-3ede1cdb6d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:17.432515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139bed-d031-4396-86c1-3ede1cdb6d20 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:17.432808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139bed-d031-4396-86c1-3ede1cdb6d20 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:17.433081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76139bed-d031-4396-86c1-3ede1cdb6d20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:17.446260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76139bed-d031-4396-86c1-3ede1cdb6d20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-76139bed-d031-4396-86c1-3ede1cdb6d20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:17.454564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:17.455724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:17.456724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 416/843] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:38:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:17.463552 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e117221-b9e9-4177-a2d9-a8c56a7525c8 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:17.584015 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e117221-b9e9-4177-a2d9-a8c56a7525c8 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:17.612864 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:17.627533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390f181-3f76-40d0-96a5-d5c183d26c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:17.628285 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f181-3f76-40d0-96a5-d5c183d26c5c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:17.628587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f181-3f76-40d0-96a5-d5c183d26c5c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:17.628992 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f181-3f76-40d0-96a5-d5c183d26c5c None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:17.629821 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390f181-3f76-40d0-96a5-d5c183d26c5c None admin] RBAC: Adding query filter params (name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:17.630115 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390f181-3f76-40d0-96a5-d5c183d26c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:17.631729 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390f181-3f76-40d0-96a5-d5c183d26c5c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:17.648279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 428/844] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:38:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:17.649543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76139bed-d031-4396-86c1-3ede1cdb6d20 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:17.707714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:17.806189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76139bed-d031-4396-86c1-3ede1cdb6d20 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:17.859715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca69e-1ebc-4612-a1a5-574617e48c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:17.860613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca69e-1ebc-4612-a1a5-574617e48c90 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:17.860904 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca69e-1ebc-4612-a1a5-574617e48c90 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:17.861183 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aca69e-1ebc-4612-a1a5-574617e48c90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:17.875095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aca69e-1ebc-4612-a1a5-574617e48c90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:17.876907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aca69e-1ebc-4612-a1a5-574617e48c90 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-37aca69e-1ebc-4612-a1a5-574617e48c90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:17.899033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:17.900157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:17.903714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:17.903714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:17.903714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:17.903714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:17.903714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 417/845] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:38:17.907038 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390f181-3f76-40d0-96a5-d5c183d26c5c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:18.035412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390f181-3f76-40d0-96a5-d5c183d26c5c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:18.076909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdcd4f-019c-4efc-a50a-038bae0a93cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:18.077588 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdcd4f-019c-4efc-a50a-038bae0a93cb None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:18.077877 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdcd4f-019c-4efc-a50a-038bae0a93cb None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:18.078239 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cdcd4f-019c-4efc-a50a-038bae0a93cb None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:18.079821 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdcd4f-019c-4efc-a50a-038bae0a93cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:18.080106 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdcd4f-019c-4efc-a50a-038bae0a93cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:18.081615 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cdcd4f-019c-4efc-a50a-038bae0a93cb None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:18.094945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 429/846] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:18.101046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca69e-1ebc-4612-a1a5-574617e48c90 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:18.208945 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:18.220026 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aca69e-1ebc-4612-a1a5-574617e48c90 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:18.257214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c74052-3416-4f79-bba2-98b3244a6d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:18.258037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c74052-3416-4f79-bba2-98b3244a6d85 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:18.258316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c74052-3416-4f79-bba2-98b3244a6d85 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:18.258629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c74052-3416-4f79-bba2-98b3244a6d85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:18.267114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c74052-3416-4f79-bba2-98b3244a6d85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:18.268640 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c74052-3416-4f79-bba2-98b3244a6d85 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-47c74052-3416-4f79-bba2-98b3244a6d85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:38:18.283177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:18.284280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:18.285536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:18.285536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:18.285536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:38:18.285536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:38:18.285536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:38:18.285536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:38:18.285536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:38:18.285536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:38:18.285536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:18.285536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:18.285536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 418/847] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:38:18.290701 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdcd4f-019c-4efc-a50a-038bae0a93cb None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:18.344190 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:18.410502 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cdcd4f-019c-4efc-a50a-038bae0a93cb None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:18.448101 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6716fe-1c7a-4f32-a582-a8829e02110c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:18.448810 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6716fe-1c7a-4f32-a582-a8829e02110c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:18.449097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6716fe-1c7a-4f32-a582-a8829e02110c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:18.449374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6716fe-1c7a-4f32-a582-a8829e02110c None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:18.450219 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6716fe-1c7a-4f32-a582-a8829e02110c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:18.450529 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6716fe-1c7a-4f32-a582-a8829e02110c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:18.452016 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6716fe-1c7a-4f32-a582-a8829e02110c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:18.471195 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 430/848] 10.222.0.24 () {56 vars in 1143 bytes} [Sat Jun 4 20:38:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:18.478643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c74052-3416-4f79-bba2-98b3244a6d85 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:18.594457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c74052-3416-4f79-bba2-98b3244a6d85 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:18.638180 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0db402-e26e-4573-95dd-078121ce257b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:18.639025 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0db402-e26e-4573-95dd-078121ce257b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:18.639307 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0db402-e26e-4573-95dd-078121ce257b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:18.639586 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0db402-e26e-4573-95dd-078121ce257b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:18.652083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0db402-e26e-4573-95dd-078121ce257b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:18.653800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0db402-e26e-4573-95dd-078121ce257b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-4c0db402-e26e-4573-95dd-078121ce257b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:18.674542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:18.675697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:18.676886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:18.676886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:18.676886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:18.676886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:18.676886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 419/849] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:18.681798 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6716fe-1c7a-4f32-a582-a8829e02110c None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:18.808530 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6716fe-1c7a-4f32-a582-a8829e02110c None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:18.811420 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:18.849701 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d642-f25e-4a97-9654-814b6289120e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:18.850404 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d642-f25e-4a97-9654-814b6289120e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:18.850684 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d642-f25e-4a97-9654-814b6289120e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:18.850955 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9d642-f25e-4a97-9654-814b6289120e None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:18.851683 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9d642-f25e-4a97-9654-814b6289120e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:18.851986 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9d642-f25e-4a97-9654-814b6289120e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:18.853499 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b9d642-f25e-4a97-9654-814b6289120e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:18.867355 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 431/850] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:18.873485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0db402-e26e-4573-95dd-078121ce257b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:18.877418 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:18.994179 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0db402-e26e-4573-95dd-078121ce257b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:19.034312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355808c-df44-4a7f-832b-705c9262dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:19.035141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355808c-df44-4a7f-832b-705c9262dc91 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:19.035422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355808c-df44-4a7f-832b-705c9262dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:19.035706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355808c-df44-4a7f-832b-705c9262dc91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:19.043554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355808c-df44-4a7f-832b-705c9262dc91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:19.045086 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355808c-df44-4a7f-832b-705c9262dc91 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-c355808c-df44-4a7f-832b-705c9262dc91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:38:19.060186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:19.061207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:19.067570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:38:19.067570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:38:19.067570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:38:19.067570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:38:19.067570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:38:19.067570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:38:19.067570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:19.067570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:19.067570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 420/851] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:38:19.068286 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d642-f25e-4a97-9654-814b6289120e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:19.191569 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9d642-f25e-4a97-9654-814b6289120e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:19.230317 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297e04d-487e-48ca-b7f3-c473d7cdfcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:19.230992 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e04d-487e-48ca-b7f3-c473d7cdfcce None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:19.231279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e04d-487e-48ca-b7f3-c473d7cdfcce None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:19.231559 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e04d-487e-48ca-b7f3-c473d7cdfcce None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:19.232356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297e04d-487e-48ca-b7f3-c473d7cdfcce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:19.232699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297e04d-487e-48ca-b7f3-c473d7cdfcce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:19.234151 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297e04d-487e-48ca-b7f3-c473d7cdfcce None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:19.248199 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 432/852] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:38:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:19.255218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355808c-df44-4a7f-832b-705c9262dc91 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:19.330209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:19.375531 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355808c-df44-4a7f-832b-705c9262dc91 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:19.416457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a0114-f982-4828-b56f-c0ad19c3613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:19.417341 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a0114-f982-4828-b56f-c0ad19c3613d None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:19.417625 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a0114-f982-4828-b56f-c0ad19c3613d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:19.417898 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a0114-f982-4828-b56f-c0ad19c3613d None admin] PATH_INFO: `/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/22f68848269a453289f64d57415fcee5/roles/b3da02096234495595b953977e8296d3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:19.437686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a0114-f982-4828-b56f-c0ad19c3613d None admin] RBAC: Authorizing `identity:create_grant(project_id=793a7b858d3848b3b0df4e9c31d20d2a, user_id=22f68848269a453289f64d57415fcee5, role_id=b3da02096234495595b953977e8296d3)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:19.439573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a0114-f982-4828-b56f-c0ad19c3613d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:19.453685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 421/853] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:38:19 2022] PUT /identity/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/22f68848269a453289f64d57415fcee5/roles/b3da02096234495595b953977e8296d3 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:38:21.917502 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfdb5f-4ec5-4b13-89b5-8473430ca55b None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:21.918038 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfdb5f-4ec5-4b13-89b5-8473430ca55b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:21.918038 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dfdb5f-4ec5-4b13-89b5-8473430ca55b None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:21.919943 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 433/854] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:21.926208 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57dcb-a181-4309-9d11-d5d20b4eaa17 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:21.926698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57dcb-a181-4309-9d11-d5d20b4eaa17 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:21.926804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f57dcb-a181-4309-9d11-d5d20b4eaa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:21.948745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-92f57dcb-a181-4309-9d11-d5d20b4eaa17 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:21.951042 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-92f57dcb-a181-4309-9d11-d5d20b4eaa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:22.043841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 422/855] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:21 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:38:22.069157 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfdb5f-4ec5-4b13-89b5-8473430ca55b None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:22.098355 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:22.185985 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dfdb5f-4ec5-4b13-89b5-8473430ca55b None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:22.226677 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a9196-b821-4427-aa8c-6f448441e7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:22.227490 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a9196-b821-4427-aa8c-6f448441e7df None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:22.227772 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a9196-b821-4427-aa8c-6f448441e7df None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:22.228043 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a9196-b821-4427-aa8c-6f448441e7df None admin] PATH_INFO: `/v3/roles/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:22.239468 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a9196-b821-4427-aa8c-6f448441e7df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-b31a9196-b821-4427-aa8c-6f448441e7df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:22.247291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:22.248393 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:22.249289 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 434/856] 10.222.0.24 () {56 vars in 1102 bytes} [Sat Jun 4 20:38:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:22.254686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f57dcb-a181-4309-9d11-d5d20b4eaa17 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:22.305433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:22.376924 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f57dcb-a181-4309-9d11-d5d20b4eaa17 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:22.424220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf8236-c731-48fa-a6ac-31deeab67704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:22.424983 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf8236-c731-48fa-a6ac-31deeab67704 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:22.425301 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf8236-c731-48fa-a6ac-31deeab67704 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:22.425686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf8236-c731-48fa-a6ac-31deeab67704 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:22.426472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf8236-c731-48fa-a6ac-31deeab67704 None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:22.426809 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf8236-c731-48fa-a6ac-31deeab67704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:22.428238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf8236-c731-48fa-a6ac-31deeab67704 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:22.440822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 423/857] 10.222.0.24 () {56 vars in 1103 bytes} [Sat Jun 4 20:38:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:22.447219 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a9196-b821-4427-aa8c-6f448441e7df None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:22.554027 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:22.574240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a9196-b821-4427-aa8c-6f448441e7df None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:22.618179 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0e1d6-56f5-4b4d-b4bf-c244e1803205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:22.618897 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e1d6-56f5-4b4d-b4bf-c244e1803205 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:22.619205 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e1d6-56f5-4b4d-b4bf-c244e1803205 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:22.619489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e1d6-56f5-4b4d-b4bf-c244e1803205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:22.633585 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0e1d6-56f5-4b4d-b4bf-c244e1803205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:22.635436 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0e1d6-56f5-4b4d-b4bf-c244e1803205 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-fdf0e1d6-56f5-4b4d-b4bf-c244e1803205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:22.657139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:22.660399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:22.661976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:22.661976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:22.661976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:22.661976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:22.661976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 435/858] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:22.664680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf8236-c731-48fa-a6ac-31deeab67704 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:22.800302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf8236-c731-48fa-a6ac-31deeab67704 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:22.804369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:22.843074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e1243-df64-4711-99df-b06aafae33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:22.843830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e1243-df64-4711-99df-b06aafae33a4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:22.844119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e1243-df64-4711-99df-b06aafae33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:22.844455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e1243-df64-4711-99df-b06aafae33a4 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:22.845183 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e1243-df64-4711-99df-b06aafae33a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:22.845492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e1243-df64-4711-99df-b06aafae33a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:22.847205 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091e1243-df64-4711-99df-b06aafae33a4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:22.865990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 424/859] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:22.868577 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0e1d6-56f5-4b4d-b4bf-c244e1803205 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:22.983244 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0e1d6-56f5-4b4d-b4bf-c244e1803205 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:23.021074 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010ddb4-bc06-45c6-a4eb-40d281960ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:23.021893 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010ddb4-bc06-45c6-a4eb-40d281960ea7 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:23.022222 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010ddb4-bc06-45c6-a4eb-40d281960ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:23.022461 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010ddb4-bc06-45c6-a4eb-40d281960ea7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:23.026064 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:23.037583 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010ddb4-bc06-45c6-a4eb-40d281960ea7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:23.039062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010ddb4-bc06-45c6-a4eb-40d281960ea7 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-c010ddb4-bc06-45c6-a4eb-40d281960ea7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:38:23.054451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:23.055827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:23.057279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:23.057279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:23.057279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:38:23.057279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:38:23.057279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:38:23.057279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:38:23.057279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:38:23.057279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:38:23.057279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:23.057279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:23.057279 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 436/860] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:23.063406 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e1243-df64-4711-99df-b06aafae33a4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:23.176460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e1243-df64-4711-99df-b06aafae33a4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:23.213355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfac76-fb11-4286-9b04-6d3d2b720bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:23.214039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfac76-fb11-4286-9b04-6d3d2b720bcf None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:23.214322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfac76-fb11-4286-9b04-6d3d2b720bcf None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:23.214598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cfac76-fb11-4286-9b04-6d3d2b720bcf None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:23.215450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfac76-fb11-4286-9b04-6d3d2b720bcf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:23.215760 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfac76-fb11-4286-9b04-6d3d2b720bcf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:23.217263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cfac76-fb11-4286-9b04-6d3d2b720bcf None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:23.237980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 425/861] 10.222.0.24 () {56 vars in 1143 bytes} [Sat Jun 4 20:38:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:23.243891 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010ddb4-bc06-45c6-a4eb-40d281960ea7 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:23.353946 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010ddb4-bc06-45c6-a4eb-40d281960ea7 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:23.389424 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca77428-654b-4574-8f48-865db70b1e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:23.390173 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77428-654b-4574-8f48-865db70b1e09 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:23.390580 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77428-654b-4574-8f48-865db70b1e09 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:23.391046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca77428-654b-4574-8f48-865db70b1e09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:23.470394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:23.479860 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca77428-654b-4574-8f48-865db70b1e09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:23.481807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca77428-654b-4574-8f48-865db70b1e09 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:23.605297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 437/862] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:38:23 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:38:23.612392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfac76-fb11-4286-9b04-6d3d2b720bcf None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:23.643908 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:23.727203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cfac76-fb11-4286-9b04-6d3d2b720bcf None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:23.764668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c66b8f-d5d5-466e-9432-1a2ede9ea6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:23.765533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c66b8f-d5d5-466e-9432-1a2ede9ea6ab None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:23.765911 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c66b8f-d5d5-466e-9432-1a2ede9ea6ab None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:23.766162 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c66b8f-d5d5-466e-9432-1a2ede9ea6ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:23.777084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c66b8f-d5d5-466e-9432-1a2ede9ea6ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:23.778566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c66b8f-d5d5-466e-9432-1a2ede9ea6ab None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-f7c66b8f-d5d5-466e-9432-1a2ede9ea6ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:23.799528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:23.800708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:23.801744 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:23.801744 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:23.801744 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:23.801744 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:23.801744 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 426/863] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:23.806799 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca77428-654b-4574-8f48-865db70b1e09 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:23.920582 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:23.928850 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca77428-654b-4574-8f48-865db70b1e09 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:23.968576 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a69b9c-fb44-42d0-adbb-ddfe1cbc594f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:23.969805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69b9c-fb44-42d0-adbb-ddfe1cbc594f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:23.970128 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69b9c-fb44-42d0-adbb-ddfe1cbc594f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:23.970459 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a69b9c-fb44-42d0-adbb-ddfe1cbc594f None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:23.971454 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a69b9c-fb44-42d0-adbb-ddfe1cbc594f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:23.971863 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a69b9c-fb44-42d0-adbb-ddfe1cbc594f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:23.973622 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a69b9c-fb44-42d0-adbb-ddfe1cbc594f None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:23.994146 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 438/864] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:23.996235 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c66b8f-d5d5-466e-9432-1a2ede9ea6ab None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:24.089708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:24.116009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c66b8f-d5d5-466e-9432-1a2ede9ea6ab None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:24.154801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa1fd8-cd02-4125-baca-b516b2f9e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:24.156168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1fd8-cd02-4125-baca-b516b2f9e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:24.156168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1fd8-cd02-4125-baca-b516b2f9e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:24.156676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa1fd8-cd02-4125-baca-b516b2f9e8b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:24.164993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa1fd8-cd02-4125-baca-b516b2f9e8b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:24.166593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa1fd8-cd02-4125-baca-b516b2f9e8b3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-a0fa1fd8-cd02-4125-baca-b516b2f9e8b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:38:24.182203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:24.183481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:24.185055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:38:24.185055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:38:24.185055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:38:24.185055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:38:24.185055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:38:24.185055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:38:24.185055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:24.185055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:24.189235 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 427/865] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 04 20:38:24.190450 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a69b9c-fb44-42d0-adbb-ddfe1cbc594f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:24.307620 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a69b9c-fb44-42d0-adbb-ddfe1cbc594f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:24.348353 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9746c5a-f87d-4f0c-9a33-1f6d1f991cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:24.349082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9746c5a-f87d-4f0c-9a33-1f6d1f991cda None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:24.349370 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9746c5a-f87d-4f0c-9a33-1f6d1f991cda None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:24.349646 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9746c5a-f87d-4f0c-9a33-1f6d1f991cda None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:24.350442 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9746c5a-f87d-4f0c-9a33-1f6d1f991cda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:24.350745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9746c5a-f87d-4f0c-9a33-1f6d1f991cda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:24.352211 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9746c5a-f87d-4f0c-9a33-1f6d1f991cda None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:24.370343 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 439/866] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:38:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:24.376690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa1fd8-cd02-4125-baca-b516b2f9e8b3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:24.504937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa1fd8-cd02-4125-baca-b516b2f9e8b3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:24.548841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43434728-6510-4588-a80c-139c6954caae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:24.549525 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43434728-6510-4588-a80c-139c6954caae None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:24.549805 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43434728-6510-4588-a80c-139c6954caae None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:24.550084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43434728-6510-4588-a80c-139c6954caae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:24.550921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43434728-6510-4588-a80c-139c6954caae None admin] RBAC: Adding query filter params (role.id=b3da02096234495595b953977e8296d3, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=22f68848269a453289f64d57415fcee5) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:24.551236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43434728-6510-4588-a80c-139c6954caae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:24.552770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43434728-6510-4588-a80c-139c6954caae None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:24.554944 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:24.560506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 428/867] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:38:24 2022] GET /identity/v3/role_assignments?user.id=22f68848269a453289f64d57415fcee5&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=b3da02096234495595b953977e8296d3 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:38:27.234561 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a587102-d91e-4988-a90c-d90d11f24dc2 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:27.235246 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a587102-d91e-4988-a90c-d90d11f24dc2 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:27.235246 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a587102-d91e-4988-a90c-d90d11f24dc2 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:27.236714 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 440/868] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:38:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:27.243464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605803d0-2204-4784-a02d-0b8928168f9d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:27.243979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605803d0-2204-4784-a02d-0b8928168f9d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:27.244144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605803d0-2204-4784-a02d-0b8928168f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:27.263420 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-605803d0-2204-4784-a02d-0b8928168f9d None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:27.264835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-605803d0-2204-4784-a02d-0b8928168f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:27.340051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 429/869] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:27 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:27.365260 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a587102-d91e-4988-a90c-d90d11f24dc2 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:27.385405 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:27.481046 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a587102-d91e-4988-a90c-d90d11f24dc2 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:27.521992 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313235e2-69f9-4835-b80d-cc4140b28a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:27.522916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313235e2-69f9-4835-b80d-cc4140b28a9e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:27.523210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313235e2-69f9-4835-b80d-cc4140b28a9e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:27.523487 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313235e2-69f9-4835-b80d-cc4140b28a9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:27.536003 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313235e2-69f9-4835-b80d-cc4140b28a9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-313235e2-69f9-4835-b80d-cc4140b28a9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:27.543892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:27.545092 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:27.546194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 441/870] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:38:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:27.553803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605803d0-2204-4784-a02d-0b8928168f9d None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:27.674756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605803d0-2204-4784-a02d-0b8928168f9d None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:27.704527 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:27.712641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956d0cd-cea6-4828-a9e9-ca623839bfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:27.713627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956d0cd-cea6-4828-a9e9-ca623839bfa8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:27.713953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956d0cd-cea6-4828-a9e9-ca623839bfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:27.714287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956d0cd-cea6-4828-a9e9-ca623839bfa8 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:27.715125 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956d0cd-cea6-4828-a9e9-ca623839bfa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:27.715441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956d0cd-cea6-4828-a9e9-ca623839bfa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:27.716978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956d0cd-cea6-4828-a9e9-ca623839bfa8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:27.727573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 430/871] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:38:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:27.734168 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313235e2-69f9-4835-b80d-cc4140b28a9e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:27.832262 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:27.859920 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313235e2-69f9-4835-b80d-cc4140b28a9e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:27.902388 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aa69d-11f6-4a3f-a70e-ed61ff0683cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:27.903228 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aa69d-11f6-4a3f-a70e-ed61ff0683cb None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:27.903536 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aa69d-11f6-4a3f-a70e-ed61ff0683cb None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:27.903786 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1aa69d-11f6-4a3f-a70e-ed61ff0683cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:27.916550 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1aa69d-11f6-4a3f-a70e-ed61ff0683cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:27.918015 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1aa69d-11f6-4a3f-a70e-ed61ff0683cb None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-ff1aa69d-11f6-4a3f-a70e-ed61ff0683cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:27.938731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:27.939916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:27.940924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:27.940924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:27.940924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:27.940924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:27.940924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 442/872] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:27.945968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956d0cd-cea6-4828-a9e9-ca623839bfa8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:28.072645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956d0cd-cea6-4828-a9e9-ca623839bfa8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:28.110666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cad63-9bc5-4f42-ae66-a8bfb892f7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:28.111247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cad63-9bc5-4f42-ae66-a8bfb892f7fd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:28.111531 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cad63-9bc5-4f42-ae66-a8bfb892f7fd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:28.111935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cad63-9bc5-4f42-ae66-a8bfb892f7fd None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:28.112713 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cad63-9bc5-4f42-ae66-a8bfb892f7fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:28.113014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cad63-9bc5-4f42-ae66-a8bfb892f7fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:28.114415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2cad63-9bc5-4f42-ae66-a8bfb892f7fd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:28.127139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 431/873] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:28.134657 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aa69d-11f6-4a3f-a70e-ed61ff0683cb None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:28.256690 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1aa69d-11f6-4a3f-a70e-ed61ff0683cb None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:28.288222 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:28.296923 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe07ff7-25a7-41f8-9d4d-6671649809cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:28.297752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe07ff7-25a7-41f8-9d4d-6671649809cc None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:28.298034 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe07ff7-25a7-41f8-9d4d-6671649809cc None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:28.298305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe07ff7-25a7-41f8-9d4d-6671649809cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:28.306528 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe07ff7-25a7-41f8-9d4d-6671649809cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:28.308000 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe07ff7-25a7-41f8-9d4d-6671649809cc None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-bbe07ff7-25a7-41f8-9d4d-6671649809cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:38:28.325041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:28.326716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:28.328018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:28.328018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:28.328018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:38:28.328018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:38:28.328018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:38:28.328018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:38:28.328018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:38:28.328018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:38:28.328018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:28.328018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:28.328018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 443/874] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:28.332242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cad63-9bc5-4f42-ae66-a8bfb892f7fd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:28.388423 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:28.454643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cad63-9bc5-4f42-ae66-a8bfb892f7fd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:28.515593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04468735-0a20-4580-91f7-f1f1ccc2c744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:28.516940 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04468735-0a20-4580-91f7-f1f1ccc2c744 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:28.517475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04468735-0a20-4580-91f7-f1f1ccc2c744 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:28.517956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04468735-0a20-4580-91f7-f1f1ccc2c744 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:28.519556 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04468735-0a20-4580-91f7-f1f1ccc2c744 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:28.521562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04468735-0a20-4580-91f7-f1f1ccc2c744 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:28.522904 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04468735-0a20-4580-91f7-f1f1ccc2c744 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:28.542601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 432/875] 10.222.0.24 () {56 vars in 1143 bytes} [Sat Jun 4 20:38:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:28.549417 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe07ff7-25a7-41f8-9d4d-6671649809cc None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:28.682490 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe07ff7-25a7-41f8-9d4d-6671649809cc None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:28.726031 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b124f-e036-4172-94d3-33bfe4e99deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:28.726685 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b124f-e036-4172-94d3-33bfe4e99deb None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:28.726975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b124f-e036-4172-94d3-33bfe4e99deb None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:28.727252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2b124f-e036-4172-94d3-33bfe4e99deb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:28.796320 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:28.812050 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b124f-e036-4172-94d3-33bfe4e99deb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:28.814017 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2b124f-e036-4172-94d3-33bfe4e99deb None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:28.935902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 444/876] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:38:28 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:38:28.943289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04468735-0a20-4580-91f7-f1f1ccc2c744 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:29.077488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04468735-0a20-4580-91f7-f1f1ccc2c744 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:29.090923 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:29.121921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41f756-4454-4a81-b2a1-becb6afdfacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:29.122863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f756-4454-4a81-b2a1-becb6afdfacd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:29.123172 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f756-4454-4a81-b2a1-becb6afdfacd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:29.123455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41f756-4454-4a81-b2a1-becb6afdfacd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:29.136356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41f756-4454-4a81-b2a1-becb6afdfacd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:29.138446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41f756-4454-4a81-b2a1-becb6afdfacd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-ed41f756-4454-4a81-b2a1-becb6afdfacd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:29.159953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:29.161114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:29.162047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:29.162047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:29.162047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:29.162047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:29.162047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 433/877] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:29.167603 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b124f-e036-4172-94d3-33bfe4e99deb None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:29.279025 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:29.293317 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2b124f-e036-4172-94d3-33bfe4e99deb None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:29.331518 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852d10a-7a55-4aeb-8ee6-bb0d1dabe0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:29.332213 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d10a-7a55-4aeb-8ee6-bb0d1dabe0ad None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:29.332532 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d10a-7a55-4aeb-8ee6-bb0d1dabe0ad None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:29.332815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d10a-7a55-4aeb-8ee6-bb0d1dabe0ad None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:29.333590 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852d10a-7a55-4aeb-8ee6-bb0d1dabe0ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:29.333900 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852d10a-7a55-4aeb-8ee6-bb0d1dabe0ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:29.335310 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852d10a-7a55-4aeb-8ee6-bb0d1dabe0ad None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:29.348873 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 445/878] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:29.354984 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41f756-4454-4a81-b2a1-becb6afdfacd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:29.471567 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41f756-4454-4a81-b2a1-becb6afdfacd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:29.519453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392867d-8927-4d71-bfec-01863fab1bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:29.520300 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392867d-8927-4d71-bfec-01863fab1bb6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:29.520617 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392867d-8927-4d71-bfec-01863fab1bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:29.520895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7392867d-8927-4d71-bfec-01863fab1bb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:29.529376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392867d-8927-4d71-bfec-01863fab1bb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:29.530807 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7392867d-8927-4d71-bfec-01863fab1bb6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-7392867d-8927-4d71-bfec-01863fab1bb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:38:29.546937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:29.548056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:29.549175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:38:29.549175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:38:29.549175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:38:29.549175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:38:29.549175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:38:29.549175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:38:29.549175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:29.549175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:29.549175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 434/879] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:38:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:29.554579 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852d10a-7a55-4aeb-8ee6-bb0d1dabe0ad None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:29.672676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852d10a-7a55-4aeb-8ee6-bb0d1dabe0ad None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:29.707672 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a8fb5-84a5-4b40-b6e1-62630dc395ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:29.708352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8fb5-84a5-4b40-b6e1-62630dc395ee None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:29.708708 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8fb5-84a5-4b40-b6e1-62630dc395ee None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:29.708987 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a8fb5-84a5-4b40-b6e1-62630dc395ee None admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:29.709816 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8fb5-84a5-4b40-b6e1-62630dc395ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:29.710128 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8fb5-84a5-4b40-b6e1-62630dc395ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:29.711569 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a8fb5-84a5-4b40-b6e1-62630dc395ee None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:29.725246 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 446/880] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:38:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:29.731856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392867d-8927-4d71-bfec-01863fab1bb6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:29.758164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:29.841280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7392867d-8927-4d71-bfec-01863fab1bb6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:29.878301 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e8eb4-b815-4662-8fee-879ab899398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:29.878961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8eb4-b815-4662-8fee-879ab899398a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:29.879241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8eb4-b815-4662-8fee-879ab899398a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:29.879518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e8eb4-b815-4662-8fee-879ab899398a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:29.880361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8eb4-b815-4662-8fee-879ab899398a None admin] RBAC: Adding query filter params (role.id=f315b062be7e445fa9461a116f9c46ee, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=22f68848269a453289f64d57415fcee5) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:29.880703 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8eb4-b815-4662-8fee-879ab899398a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:29.882163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e8eb4-b815-4662-8fee-879ab899398a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:29.888742 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 435/881] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:38:29 2022] GET /identity/v3/role_assignments?user.id=22f68848269a453289f64d57415fcee5&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=f315b062be7e445fa9461a116f9c46ee => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:32.299773 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6918-9b7e-4307-81c3-e12ede7f7f4c None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:32.300403 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6918-9b7e-4307-81c3-e12ede7f7f4c None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:32.300403 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a6918-9b7e-4307-81c3-e12ede7f7f4c None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:32.301763 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 447/882] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:32.307769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ead0ea-9bad-4a9b-b0de-2f488484fcf0 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:32.308350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ead0ea-9bad-4a9b-b0de-2f488484fcf0 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:32.308350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ead0ea-9bad-4a9b-b0de-2f488484fcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:32.327376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c5ead0ea-9bad-4a9b-b0de-2f488484fcf0 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:32.328765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c5ead0ea-9bad-4a9b-b0de-2f488484fcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:32.408979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 436/883] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:32.433623 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a6918-9b7e-4307-81c3-e12ede7f7f4c None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:32.449761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:32.547894 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a6918-9b7e-4307-81c3-e12ede7f7f4c None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:32.589946 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7fb23-f0aa-4086-a19e-282741a1e7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:32.590670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7fb23-f0aa-4086-a19e-282741a1e7e6 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:32.590957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7fb23-f0aa-4086-a19e-282741a1e7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:32.591234 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7fb23-f0aa-4086-a19e-282741a1e7e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:32.604227 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7fb23-f0aa-4086-a19e-282741a1e7e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-76c7fb23-f0aa-4086-a19e-282741a1e7e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:32.615240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:32.616210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:32.617086 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:32.617707 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 448/884] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:38:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:32.623562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ead0ea-9bad-4a9b-b0de-2f488484fcf0 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:32.641414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:32.734933 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ead0ea-9bad-4a9b-b0de-2f488484fcf0 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:32.773556 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c668e-a662-40a1-8b8e-1a50b2e320c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:32.774237 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c668e-a662-40a1-8b8e-1a50b2e320c5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:32.774523 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c668e-a662-40a1-8b8e-1a50b2e320c5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:32.774798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c668e-a662-40a1-8b8e-1a50b2e320c5 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:32.775559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c668e-a662-40a1-8b8e-1a50b2e320c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:32.775868 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c668e-a662-40a1-8b8e-1a50b2e320c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:32.777318 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c668e-a662-40a1-8b8e-1a50b2e320c5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:32.786434 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 437/885] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:38:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:32.792692 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7fb23-f0aa-4086-a19e-282741a1e7e6 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:32.865230 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:32.900669 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7fb23-f0aa-4086-a19e-282741a1e7e6 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:32.935917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e813a-46f2-453f-b4e7-9debe855030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:32.936788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e813a-46f2-453f-b4e7-9debe855030a None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:32.937163 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e813a-46f2-453f-b4e7-9debe855030a None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:32.937801 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e813a-46f2-453f-b4e7-9debe855030a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:32.948567 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e813a-46f2-453f-b4e7-9debe855030a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:32.950049 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57e813a-46f2-453f-b4e7-9debe855030a None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-b57e813a-46f2-453f-b4e7-9debe855030a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:32.967699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:32.968949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:32.969980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:32.969980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:32.969980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:32.969980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:32.969980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 449/886] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:32.975414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c668e-a662-40a1-8b8e-1a50b2e320c5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:33.058019 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:33.083904 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c668e-a662-40a1-8b8e-1a50b2e320c5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:33.120070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c154-00d6-4152-b46e-7f1ae6b44a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:33.120688 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c154-00d6-4152-b46e-7f1ae6b44a57 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:33.120973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c154-00d6-4152-b46e-7f1ae6b44a57 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:33.121249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c154-00d6-4152-b46e-7f1ae6b44a57 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:33.121978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274c154-00d6-4152-b46e-7f1ae6b44a57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:33.122291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274c154-00d6-4152-b46e-7f1ae6b44a57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:33.123714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3274c154-00d6-4152-b46e-7f1ae6b44a57 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:33.136816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 438/887] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:33.143059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e813a-46f2-453f-b4e7-9debe855030a None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:33.246894 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e813a-46f2-453f-b4e7-9debe855030a None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:33.267935 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:33.284871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d15c5-c8d3-4fa6-ad7c-277839869595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:33.285683 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d15c5-c8d3-4fa6-ad7c-277839869595 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:33.285970 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d15c5-c8d3-4fa6-ad7c-277839869595 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:33.286240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d15c5-c8d3-4fa6-ad7c-277839869595 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:33.294277 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d15c5-c8d3-4fa6-ad7c-277839869595 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:33.295722 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d15c5-c8d3-4fa6-ad7c-277839869595 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-310d15c5-c8d3-4fa6-ad7c-277839869595 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:38:33.310807 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:33.312261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:33.313431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:33.313431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:33.313431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:38:33.313431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:38:33.313431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:38:33.313431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:38:33.313431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:38:33.313431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:38:33.313431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:33.313431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:33.313431 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 450/888] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:33.318166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c154-00d6-4152-b46e-7f1ae6b44a57 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:33.430808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c154-00d6-4152-b46e-7f1ae6b44a57 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:33.467694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e7416-3e60-4695-87d0-63bd1e3dd65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:33.468992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e7416-3e60-4695-87d0-63bd1e3dd65d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:33.469281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e7416-3e60-4695-87d0-63bd1e3dd65d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:33.469564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e7416-3e60-4695-87d0-63bd1e3dd65d None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:33.470412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e7416-3e60-4695-87d0-63bd1e3dd65d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:33.470716 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e7416-3e60-4695-87d0-63bd1e3dd65d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:33.472168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e7416-3e60-4695-87d0-63bd1e3dd65d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:33.474832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:33.491110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 439/889] 10.222.0.24 () {56 vars in 1143 bytes} [Sat Jun 4 20:38:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:33.496987 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d15c5-c8d3-4fa6-ad7c-277839869595 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:33.607164 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d15c5-c8d3-4fa6-ad7c-277839869595 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:33.645853 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00897476-9e7f-4303-93cb-f6ddd18b465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:33.646649 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00897476-9e7f-4303-93cb-f6ddd18b465f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:33.646929 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00897476-9e7f-4303-93cb-f6ddd18b465f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:33.647206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00897476-9e7f-4303-93cb-f6ddd18b465f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:33.658854 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00897476-9e7f-4303-93cb-f6ddd18b465f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:33.660298 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00897476-9e7f-4303-93cb-f6ddd18b465f None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-00897476-9e7f-4303-93cb-f6ddd18b465f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:33.677618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:33.678616 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:33.684334 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:33.684334 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:33.684334 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:33.684334 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:33.684334 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 451/890] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:33.684773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e7416-3e60-4695-87d0-63bd1e3dd65d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:33.790395 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e7416-3e60-4695-87d0-63bd1e3dd65d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:33.830586 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca05bff-f269-46ad-81ef-e517a172b0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:33.831265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05bff-f269-46ad-81ef-e517a172b0c4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:33.831555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05bff-f269-46ad-81ef-e517a172b0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:33.831832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca05bff-f269-46ad-81ef-e517a172b0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:33.832622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca05bff-f269-46ad-81ef-e517a172b0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:33.832926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca05bff-f269-46ad-81ef-e517a172b0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:33.834391 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca05bff-f269-46ad-81ef-e517a172b0c4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:33.846351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 440/891] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:33.852338 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00897476-9e7f-4303-93cb-f6ddd18b465f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:33.888728 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:33.965909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00897476-9e7f-4303-93cb-f6ddd18b465f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:34.002630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c6366-8378-4a16-96ec-200e35bee5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:34.003426 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c6366-8378-4a16-96ec-200e35bee5e8 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:34.003713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c6366-8378-4a16-96ec-200e35bee5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:34.003993 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c6366-8378-4a16-96ec-200e35bee5e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:34.011579 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c6366-8378-4a16-96ec-200e35bee5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:34.013115 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c6366-8378-4a16-96ec-200e35bee5e8 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-775c6366-8378-4a16-96ec-200e35bee5e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:38:34.028352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:34.029390 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:34.030316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:38:34.030316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:38:34.030316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:38:34.030316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:38:34.030316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:38:34.030316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:38:34.030316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:34.030316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:34.030316 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 452/892] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:38:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:34.036529 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca05bff-f269-46ad-81ef-e517a172b0c4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:34.100613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:34.148454 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca05bff-f269-46ad-81ef-e517a172b0c4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:34.184058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b48741-a9f1-4d63-b630-2144d1b1c108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:34.184738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b48741-a9f1-4d63-b630-2144d1b1c108 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:34.185052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b48741-a9f1-4d63-b630-2144d1b1c108 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:34.185333 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b48741-a9f1-4d63-b630-2144d1b1c108 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:34.186116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b48741-a9f1-4d63-b630-2144d1b1c108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:34.186421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b48741-a9f1-4d63-b630-2144d1b1c108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:34.188015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b48741-a9f1-4d63-b630-2144d1b1c108 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:34.200982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 441/893] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:38:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:34.207660 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c6366-8378-4a16-96ec-200e35bee5e8 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:34.305436 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:34.314921 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c6366-8378-4a16-96ec-200e35bee5e8 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:34.350645 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae12264-3100-4b70-ae64-ebdf4addb5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:34.351533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12264-3100-4b70-ae64-ebdf4addb5b2 None admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:34.351811 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12264-3100-4b70-ae64-ebdf4addb5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:34.352081 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae12264-3100-4b70-ae64-ebdf4addb5b2 None admin] PATH_INFO: `/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/22f68848269a453289f64d57415fcee5/roles/f315b062be7e445fa9461a116f9c46ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:34.354113 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae12264-3100-4b70-ae64-ebdf4addb5b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=793a7b858d3848b3b0df4e9c31d20d2a, user_id=22f68848269a453289f64d57415fcee5, role_id=f315b062be7e445fa9461a116f9c46ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:34.355547 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae12264-3100-4b70-ae64-ebdf4addb5b2 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:34.370348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 453/894] 10.222.0.24 () {58 vars in 1439 bytes} [Sat Jun 4 20:38:34 2022] PUT /identity/v3/projects/793a7b858d3848b3b0df4e9c31d20d2a/users/22f68848269a453289f64d57415fcee5/roles/f315b062be7e445fa9461a116f9c46ee => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:38:36.726139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c4571-d477-40e7-a9bf-1f224c05ef6e None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:36.726693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c4571-d477-40e7-a9bf-1f224c05ef6e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:36.726693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c4571-d477-40e7-a9bf-1f224c05ef6e None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:36.728068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 442/895] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:36.734033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd147e9-e91a-4e34-a745-2bf9ffc9e32d None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:36.734495 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd147e9-e91a-4e34-a745-2bf9ffc9e32d None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:36.734594 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd147e9-e91a-4e34-a745-2bf9ffc9e32d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:36.752717 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-7fd147e9-e91a-4e34-a745-2bf9ffc9e32d None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:36.754411 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-7fd147e9-e91a-4e34-a745-2bf9ffc9e32d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:36.826959 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 454/896] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:36.852588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c4571-d477-40e7-a9bf-1f224c05ef6e None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:36.962964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c4571-d477-40e7-a9bf-1f224c05ef6e None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:36.977463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:37.001164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c7d58-9506-47ab-9b88-b39f515fa5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:37.001968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7d58-9506-47ab-9b88-b39f515fa5a2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:37.002254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7d58-9506-47ab-9b88-b39f515fa5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:37.002532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c7d58-9506-47ab-9b88-b39f515fa5a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:37.013837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c7d58-9506-47ab-9b88-b39f515fa5a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-c08c7d58-9506-47ab-9b88-b39f515fa5a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 04 20:38:37.021963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:37.023066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:37.024094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 443/897] 10.222.0.24 () {56 vars in 1096 bytes} [Sat Jun 4 20:38:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:37.029582 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd147e9-e91a-4e34-a745-2bf9ffc9e32d None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:37.117058 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:37.138640 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd147e9-e91a-4e34-a745-2bf9ffc9e32d None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:37.175420 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf76c-2440-44ea-af87-9cf76c8b4d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:37.176098 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf76c-2440-44ea-af87-9cf76c8b4d42 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:37.176385 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf76c-2440-44ea-af87-9cf76c8b4d42 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:37.176699 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcf76c-2440-44ea-af87-9cf76c8b4d42 None admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:37.177458 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcf76c-2440-44ea-af87-9cf76c8b4d42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:37.177767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcf76c-2440-44ea-af87-9cf76c8b4d42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:37.179161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bcf76c-2440-44ea-af87-9cf76c8b4d42 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:37.187636 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 455/898] 10.222.0.24 () {56 vars in 1099 bytes} [Sat Jun 4 20:38:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:38:37.193732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c7d58-9506-47ab-9b88-b39f515fa5a2 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:37.310765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c7d58-9506-47ab-9b88-b39f515fa5a2 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:37.357764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46922b8-07f4-40c7-be23-9ba8f43e9482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:37.358612 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46922b8-07f4-40c7-be23-9ba8f43e9482 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:37.358948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46922b8-07f4-40c7-be23-9ba8f43e9482 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:37.359300 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46922b8-07f4-40c7-be23-9ba8f43e9482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:37.371884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46922b8-07f4-40c7-be23-9ba8f43e9482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:37.373665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46922b8-07f4-40c7-be23-9ba8f43e9482 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-d46922b8-07f4-40c7-be23-9ba8f43e9482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:37.391611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:37.392680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:37.393595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:37.393595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:37.393595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:37.393595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:37.396666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 444/899] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:37.398792 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf76c-2440-44ea-af87-9cf76c8b4d42 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:37.509959 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bcf76c-2440-44ea-af87-9cf76c8b4d42 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:37.548510 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aecef-4eb3-4bed-bc1c-7778761c1af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:37.549192 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aecef-4eb3-4bed-bc1c-7778761c1af3 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:37.549479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aecef-4eb3-4bed-bc1c-7778761c1af3 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:37.549755 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aecef-4eb3-4bed-bc1c-7778761c1af3 None admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:37.550489 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aecef-4eb3-4bed-bc1c-7778761c1af3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:37.550797 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aecef-4eb3-4bed-bc1c-7778761c1af3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:37.552174 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aecef-4eb3-4bed-bc1c-7778761c1af3 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:37.565382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 456/900] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:37.571540 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46922b8-07f4-40c7-be23-9ba8f43e9482 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:37.612884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:37.716660 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46922b8-07f4-40c7-be23-9ba8f43e9482 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:37.757787 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba0073-d6c8-4b8d-a930-6c022df7373d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:37.758632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba0073-d6c8-4b8d-a930-6c022df7373d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:37.758901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba0073-d6c8-4b8d-a930-6c022df7373d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:37.759178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba0073-d6c8-4b8d-a930-6c022df7373d None admin] PATH_INFO: `/v3/users/placement` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:37.768696 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba0073-d6c8-4b8d-a930-6c022df7373d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:37.770203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba0073-d6c8-4b8d-a930-6c022df7373d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-10ba0073-d6c8-4b8d-a930-6c022df7373d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 04 20:38:37.786120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:37.787261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:37.788222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:37.788222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:37.788222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 04 20:38:37.788222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 04 20:38:37.788222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 04 20:38:37.788222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 04 20:38:37.788222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 04 20:38:37.788222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 04 20:38:37.788222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 04 20:38:37.788222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:37.788222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 445/901] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:37.793810 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aecef-4eb3-4bed-bc1c-7778761c1af3 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:37.798593 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:37.907330 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aecef-4eb3-4bed-bc1c-7778761c1af3 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:37.942640 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631286d-2d1b-42d9-ad94-f9f61d74cb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:37.943309 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631286d-2d1b-42d9-ad94-f9f61d74cb4e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:37.943588 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631286d-2d1b-42d9-ad94-f9f61d74cb4e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:37.943856 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631286d-2d1b-42d9-ad94-f9f61d74cb4e None admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:37.945189 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631286d-2d1b-42d9-ad94-f9f61d74cb4e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:37.945189 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631286d-2d1b-42d9-ad94-f9f61d74cb4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:37.946447 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631286d-2d1b-42d9-ad94-f9f61d74cb4e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:37.964747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 457/902] 10.222.0.24 () {56 vars in 1143 bytes} [Sat Jun 4 20:38:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:37.971756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba0073-d6c8-4b8d-a930-6c022df7373d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:38.065931 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:38.083155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba0073-d6c8-4b8d-a930-6c022df7373d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:38.119912 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed9838-eab1-4482-94ed-1d4d04d3ed51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:38.120621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed9838-eab1-4482-94ed-1d4d04d3ed51 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:38.120899 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed9838-eab1-4482-94ed-1d4d04d3ed51 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:38.121168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed9838-eab1-4482-94ed-1d4d04d3ed51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:38.191742 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed9838-eab1-4482-94ed-1d4d04d3ed51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:38.193244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed9838-eab1-4482-94ed-1d4d04d3ed51 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:38.279892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:38.299873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 446/903] 10.222.0.24 () {58 vars in 1282 bytes} [Sat Jun 4 20:38:37 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 04 20:38:38.305890 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631286d-2d1b-42d9-ad94-f9f61d74cb4e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:38.379873 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:38.423476 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631286d-2d1b-42d9-ad94-f9f61d74cb4e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:38.459415 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe506a4-9eea-473f-aaaa-4a3f36892f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:38.460211 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe506a4-9eea-473f-aaaa-4a3f36892f68 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:38.460502 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe506a4-9eea-473f-aaaa-4a3f36892f68 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:38.460800 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe506a4-9eea-473f-aaaa-4a3f36892f68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:38.471529 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe506a4-9eea-473f-aaaa-4a3f36892f68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:38.473080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe506a4-9eea-473f-aaaa-4a3f36892f68 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-0fe506a4-9eea-473f-aaaa-4a3f36892f68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 04 20:38:38.490817 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:38.491882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:38.493032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 04 20:38:38.493032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 04 20:38:38.493032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 04 20:38:38.493032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:38.493032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 458/904] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:38:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:38.498047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed9838-eab1-4482-94ed-1d4d04d3ed51 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:38.610892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed9838-eab1-4482-94ed-1d4d04d3ed51 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:38.649603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56a044-3e41-482d-a338-a3d360b4a645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:38.650263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56a044-3e41-482d-a338-a3d360b4a645 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:38.650544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56a044-3e41-482d-a338-a3d360b4a645 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:38.650822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56a044-3e41-482d-a338-a3d360b4a645 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:38.651546 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56a044-3e41-482d-a338-a3d360b4a645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:38.651854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56a044-3e41-482d-a338-a3d360b4a645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:38.653471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af56a044-3e41-482d-a338-a3d360b4a645 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:38.664994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 447/905] 10.222.0.24 () {56 vars in 1109 bytes} [Sat Jun 4 20:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:38.670990 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe506a4-9eea-473f-aaaa-4a3f36892f68 None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:38.776968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe506a4-9eea-473f-aaaa-4a3f36892f68 None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:38.792156 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:38.817277 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93abed0-d85a-42e7-bb53-1fc5cf29df3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:38.818080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93abed0-d85a-42e7-bb53-1fc5cf29df3f None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:38.818362 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93abed0-d85a-42e7-bb53-1fc5cf29df3f None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:38.818636 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93abed0-d85a-42e7-bb53-1fc5cf29df3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:38.825520 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93abed0-d85a-42e7-bb53-1fc5cf29df3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:38.826973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93abed0-d85a-42e7-bb53-1fc5cf29df3f None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application [None req-e93abed0-d85a-42e7-bb53-1fc5cf29df3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 04 20:38:38.840749 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:38.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:38.842679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 04 20:38:38.842679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 04 20:38:38.842679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 04 20:38:38.842679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 04 20:38:38.842679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 04 20:38:38.842679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 04 20:38:38.842679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 04 20:38:38.842679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: ERROR keystone.server.flask.application Jun 04 20:38:38.842679 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 459/906] 10.222.0.24 () {56 vars in 1111 bytes} [Sat Jun 4 20:38:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:38.848163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56a044-3e41-482d-a338-a3d360b4a645 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:38.900205 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:38.955769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56a044-3e41-482d-a338-a3d360b4a645 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:38.990821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cfec8-899a-4f52-a413-742bc70bddc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:38.991479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cfec8-899a-4f52-a413-742bc70bddc8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:38.991764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cfec8-899a-4f52-a413-742bc70bddc8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:38.992018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cfec8-899a-4f52-a413-742bc70bddc8 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:38.992845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cfec8-899a-4f52-a413-742bc70bddc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:38.993158 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cfec8-899a-4f52-a413-742bc70bddc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:38.994617 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cfec8-899a-4f52-a413-742bc70bddc8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:39.006938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 448/907] 10.222.0.24 () {56 vars in 1148 bytes} [Sat Jun 4 20:38:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:38:39.013710 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93abed0-d85a-42e7-bb53-1fc5cf29df3f None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:39.122407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93abed0-d85a-42e7-bb53-1fc5cf29df3f None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:39.158327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c51bc-c56c-4a59-9588-1887eca1892c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:39.158904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c51bc-c56c-4a59-9588-1887eca1892c None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:39.159190 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c51bc-c56c-4a59-9588-1887eca1892c None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:39.159467 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c51bc-c56c-4a59-9588-1887eca1892c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:39.160276 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c51bc-c56c-4a59-9588-1887eca1892c None admin] RBAC: Adding query filter params (role.id=f315b062be7e445fa9461a116f9c46ee, scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a, user.id=22f68848269a453289f64d57415fcee5) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:39.160669 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c51bc-c56c-4a59-9588-1887eca1892c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:39.162101 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c51bc-c56c-4a59-9588-1887eca1892c None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:39.168240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 460/908] 10.222.0.24 () {56 vars in 1374 bytes} [Sat Jun 4 20:38:39 2022] GET /identity/v3/role_assignments?user.id=22f68848269a453289f64d57415fcee5&scope.project.id=793a7b858d3848b3b0df4e9c31d20d2a&role.id=f315b062be7e445fa9461a116f9c46ee => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:41.512937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9913a7-f920-440d-bc8e-3501bb696076 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:41.513566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9913a7-f920-440d-bc8e-3501bb696076 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:41.513566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9913a7-f920-440d-bc8e-3501bb696076 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:41.514944 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 449/909] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:38:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:41.520671 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96076181-6376-499e-b813-978616b8e651 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:41.521129 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96076181-6376-499e-b813-978616b8e651 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:41.521231 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96076181-6376-499e-b813-978616b8e651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:41.539408 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-96076181-6376-499e-b813-978616b8e651 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:41.540652 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-96076181-6376-499e-b813-978616b8e651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:41.572610 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:41.614290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 461/910] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:41 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:41.638741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9913a7-f920-440d-bc8e-3501bb696076 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:41.757623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9913a7-f920-440d-bc8e-3501bb696076 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:41.765722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:41.794456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38551236-06a3-4b61-848a-29c7a05e994b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:41.795259 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38551236-06a3-4b61-848a-29c7a05e994b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:41.795539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38551236-06a3-4b61-848a-29c7a05e994b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:41.795852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38551236-06a3-4b61-848a-29c7a05e994b None admin] PATH_INFO: `/v3/services/placement` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:41.796556 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38551236-06a3-4b61-848a-29c7a05e994b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:41.797948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38551236-06a3-4b61-848a-29c7a05e994b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-38551236-06a3-4b61-848a-29c7a05e994b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:41.810053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:41.811345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 450/911] 10.222.0.24 () {56 vars in 1117 bytes} [Sat Jun 4 20:38:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:41.818846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96076181-6376-499e-b813-978616b8e651 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:41.934264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96076181-6376-499e-b813-978616b8e651 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:41.970317 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e89945-01f0-42e4-b0f0-cef3ebd97d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:41.970986 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e89945-01f0-42e4-b0f0-cef3ebd97d86 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:41.971273 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e89945-01f0-42e4-b0f0-cef3ebd97d86 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:41.971551 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e89945-01f0-42e4-b0f0-cef3ebd97d86 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:41.972264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e89945-01f0-42e4-b0f0-cef3ebd97d86 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:41.972587 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e89945-01f0-42e4-b0f0-cef3ebd97d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:41.974001 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e89945-01f0-42e4-b0f0-cef3ebd97d86 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:41.979106 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 462/912] 10.222.0.24 () {56 vars in 1116 bytes} [Sat Jun 4 20:38:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:41.985322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38551236-06a3-4b61-848a-29c7a05e994b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:42.094515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38551236-06a3-4b61-848a-29c7a05e994b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:42.134843 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da68fd2-a0c9-406e-8057-fde7557bdb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:42.135851 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da68fd2-a0c9-406e-8057-fde7557bdb83 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:42.136127 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da68fd2-a0c9-406e-8057-fde7557bdb83 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:42.136397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da68fd2-a0c9-406e-8057-fde7557bdb83 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:42.137129 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da68fd2-a0c9-406e-8057-fde7557bdb83 None admin] RBAC: Adding query filter params (type=placement) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:42.137430 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da68fd2-a0c9-406e-8057-fde7557bdb83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:42.138810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da68fd2-a0c9-406e-8057-fde7557bdb83 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:42.143901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 451/913] 10.222.0.24 () {56 vars in 1116 bytes} [Sat Jun 4 20:38:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:44.496712 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59e4e-03ad-4392-9f5e-5740238b0975 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:44.497274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59e4e-03ad-4392-9f5e-5740238b0975 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:44.497274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a59e4e-03ad-4392-9f5e-5740238b0975 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:44.498629 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 463/914] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:44.504381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52388-71dc-48d8-bf15-35ff42e58470 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:44.504905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52388-71dc-48d8-bf15-35ff42e58470 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:44.504999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52388-71dc-48d8-bf15-35ff42e58470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:44.523767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e4e52388-71dc-48d8-bf15-35ff42e58470 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:44.525043 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e4e52388-71dc-48d8-bf15-35ff42e58470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:44.556637 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:44.603235 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 452/915] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:44 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 04 20:38:44.634548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59e4e-03ad-4392-9f5e-5740238b0975 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:44.678059 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:44.755265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a59e4e-03ad-4392-9f5e-5740238b0975 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:44.791875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b3bbc-0a30-4623-85b6-41126d4c38de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:44.792576 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b3bbc-0a30-4623-85b6-41126d4c38de None admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:44.792868 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b3bbc-0a30-4623-85b6-41126d4c38de None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:44.793147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b3bbc-0a30-4623-85b6-41126d4c38de None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:44.793875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b3bbc-0a30-4623-85b6-41126d4c38de None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:44.795271 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b3bbc-0a30-4623-85b6-41126d4c38de None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:44.810060 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 464/916] 10.222.0.24 () {60 vars in 1141 bytes} [Sat Jun 4 20:38:44 2022] POST /identity/v3/services => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:38:47.130479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127d4d-cd5c-4084-bec2-fee21f1c323f None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:47.131053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127d4d-cd5c-4084-bec2-fee21f1c323f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:47.131053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92127d4d-cd5c-4084-bec2-fee21f1c323f None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:47.132465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 453/917] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:47.138395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a9ba-c7a7-432e-bdc8-97227b38b64b None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:47.138845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a9ba-c7a7-432e-bdc8-97227b38b64b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:47.138957 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1887a9ba-c7a7-432e-bdc8-97227b38b64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:47.159009 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-1887a9ba-c7a7-432e-bdc8-97227b38b64b None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:47.160199 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-1887a9ba-c7a7-432e-bdc8-97227b38b64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:47.239812 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 465/918] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:47 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:47.266826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92127d4d-cd5c-4084-bec2-fee21f1c323f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:47.378815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92127d4d-cd5c-4084-bec2-fee21f1c323f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:47.415663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8c1c1-eb48-4c2e-94e1-23d35474873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:47.416380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c1c1-eb48-4c2e-94e1-23d35474873d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:47.416700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c1c1-eb48-4c2e-94e1-23d35474873d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:47.416977 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c1c1-eb48-4c2e-94e1-23d35474873d None admin] PATH_INFO: `/v3/services/placement` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:47.417643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8c1c1-eb48-4c2e-94e1-23d35474873d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:47.419010 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8c1c1-eb48-4c2e-94e1-23d35474873d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-57c8c1c1-eb48-4c2e-94e1-23d35474873d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:47.431285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:47.432338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:47.433195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 454/919] 10.222.0.24 () {56 vars in 1117 bytes} [Sat Jun 4 20:38:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:47.439135 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887a9ba-c7a7-432e-bdc8-97227b38b64b None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:47.460096 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:47.562526 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1887a9ba-c7a7-432e-bdc8-97227b38b64b None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:47.603014 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa83884-0307-43fc-8a45-bf274eb4597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:47.603816 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa83884-0307-43fc-8a45-bf274eb4597e None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:47.604108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa83884-0307-43fc-8a45-bf274eb4597e None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:47.604532 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa83884-0307-43fc-8a45-bf274eb4597e None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:47.605277 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa83884-0307-43fc-8a45-bf274eb4597e None admin] RBAC: Adding query filter params (name=placement) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:47.605630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa83884-0307-43fc-8a45-bf274eb4597e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:47.607313 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa83884-0307-43fc-8a45-bf274eb4597e None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:47.615590 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 466/920] 10.222.0.24 () {56 vars in 1116 bytes} [Sat Jun 4 20:38:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:47.622363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8c1c1-eb48-4c2e-94e1-23d35474873d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:47.656912 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:47.745927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8c1c1-eb48-4c2e-94e1-23d35474873d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:47.783267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c889a-5789-46b2-b059-ee62e7a3b4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:47.783927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c889a-5789-46b2-b059-ee62e7a3b4f8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:47.784212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c889a-5789-46b2-b059-ee62e7a3b4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:47.784477 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c889a-5789-46b2-b059-ee62e7a3b4f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:47.785290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c889a-5789-46b2-b059-ee62e7a3b4f8 None admin] RBAC: Adding query filter params (interface=public, service_id=74cc60818e5d48af91b891e5474e81a0, region_id=RegionOne) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:47.785598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c889a-5789-46b2-b059-ee62e7a3b4f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:47.786998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c889a-5789-46b2-b059-ee62e7a3b4f8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:47.792266 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 455/921] 10.222.0.24 () {56 vars in 1251 bytes} [Sat Jun 4 20:38:47 2022] GET /identity/v3/endpoints?service_id=74cc60818e5d48af91b891e5474e81a0&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:47.798341 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa83884-0307-43fc-8a45-bf274eb4597e None admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:47.885407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:47.906127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa83884-0307-43fc-8a45-bf274eb4597e None admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:47.942986 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb336a-37f0-463d-97c7-24b0aa9dd859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:47.944000 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb336a-37f0-463d-97c7-24b0aa9dd859 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:47.944566 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb336a-37f0-463d-97c7-24b0aa9dd859 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:47.945047 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb336a-37f0-463d-97c7-24b0aa9dd859 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:47.945859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb336a-37f0-463d-97c7-24b0aa9dd859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:47.947449 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb336a-37f0-463d-97c7-24b0aa9dd859 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:47.955008 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 467/922] 10.222.0.24 () {56 vars in 1087 bytes} [Sat Jun 4 20:38:47 2022] GET /identity/v3/services => generated 1962 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:38:50.255861 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e180d2-ad2b-472b-8fa2-97fc42250ee7 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:50.256475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e180d2-ad2b-472b-8fa2-97fc42250ee7 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:50.256475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e180d2-ad2b-472b-8fa2-97fc42250ee7 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:50.257821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 456/923] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:38:50.264601 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f883-741b-415b-8ddd-dd0e59b9cd12 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:50.265079 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f883-741b-415b-8ddd-dd0e59b9cd12 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:50.265170 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65f883-741b-415b-8ddd-dd0e59b9cd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:50.288769 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-6d65f883-741b-415b-8ddd-dd0e59b9cd12 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:38:50.290529 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-6d65f883-741b-415b-8ddd-dd0e59b9cd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:38:50.373213 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 468/924] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:38:50 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 04 20:38:50.398377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e180d2-ad2b-472b-8fa2-97fc42250ee7 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:50.500408 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:50.513172 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e180d2-ad2b-472b-8fa2-97fc42250ee7 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:50.552149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c9ee3-3001-4059-a624-ca585d9b0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:50.552999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c9ee3-3001-4059-a624-ca585d9b0901 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:50.553282 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c9ee3-3001-4059-a624-ca585d9b0901 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:50.553551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c9ee3-3001-4059-a624-ca585d9b0901 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:50.554211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c9ee3-3001-4059-a624-ca585d9b0901 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:50.555600 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c9ee3-3001-4059-a624-ca585d9b0901 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-904c9ee3-3001-4059-a624-ca585d9b0901 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 04 20:38:50.567624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 04 20:38:50.568840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jun 04 20:38:50.569845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 457/925] 10.222.0.24 () {56 vars in 1117 bytes} [Sat Jun 4 20:38:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 04 20:38:50.575443 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f883-741b-415b-8ddd-dd0e59b9cd12 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:50.658846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:38:50.688584 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65f883-741b-415b-8ddd-dd0e59b9cd12 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:50.736639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6299d-57e7-4f80-991e-36bf83bd9635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:50.737477 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6299d-57e7-4f80-991e-36bf83bd9635 None admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:50.737759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6299d-57e7-4f80-991e-36bf83bd9635 None admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:50.738025 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6299d-57e7-4f80-991e-36bf83bd9635 None admin] PATH_INFO: `/v3/services` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:50.738736 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6299d-57e7-4f80-991e-36bf83bd9635 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:38:50.739041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6299d-57e7-4f80-991e-36bf83bd9635 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:50.740462 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6299d-57e7-4f80-991e-36bf83bd9635 None admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:50.747712 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 469/926] 10.222.0.24 () {56 vars in 1116 bytes} [Sat Jun 4 20:38:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:38:50.754067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c9ee3-3001-4059-a624-ca585d9b0901 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:38:50.877366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c9ee3-3001-4059-a624-ca585d9b0901 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:38:50.913738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463336dc-4a04-4846-a499-9e7e9c946f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:38:50.914395 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463336dc-4a04-4846-a499-9e7e9c946f16 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:38:50.914671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463336dc-4a04-4846-a499-9e7e9c946f16 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:38:50.914943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463336dc-4a04-4846-a499-9e7e9c946f16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:38:50.915693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463336dc-4a04-4846-a499-9e7e9c946f16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:38:50.917187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463336dc-4a04-4846-a499-9e7e9c946f16 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:38:50.939748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 458/927] 10.222.0.24 () {60 vars in 1144 bytes} [Sat Jun 4 20:38:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:39:00.743716 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=30 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:39:00.935670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:39:52.202101 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4d5e-bfc1-4671-83d4-22ab651dcdcc None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:52.202594 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4d5e-bfc1-4671-83d4-22ab651dcdcc None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:52.202673 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b4d5e-bfc1-4671-83d4-22ab651dcdcc None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:52.210481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1679-81ac-4d12-83ac-b1c6e27d9c8f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:52.211074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1679-81ac-4d12-83ac-b1c6e27d9c8f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:52.211074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded1679-81ac-4d12-83ac-b1c6e27d9c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:52.212527 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 470/928] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:39:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:39:52.233146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-2ded1679-81ac-4d12-83ac-b1c6e27d9c8f None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:39:52.234400 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-2ded1679-81ac-4d12-83ac-b1c6e27d9c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:39:52.328475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 459/929] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:39:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:39:52.388343 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eac55-e01c-401e-84be-3b233eb89e86 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:52.388998 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eac55-e01c-401e-84be-3b233eb89e86 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:52.389424 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15eac55-e01c-401e-84be-3b233eb89e86 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:52.391012 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 471/930] 10.222.0.24 () {54 vars in 964 bytes} [Sat Jun 4 20:39:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:39:52.401286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76165e0-ff7c-4639-9980-901e97199a6c None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:52.401905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76165e0-ff7c-4639-9980-901e97199a6c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:52.402252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76165e0-ff7c-4639-9980-901e97199a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:52.490917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-d76165e0-ff7c-4639-9980-901e97199a6c None None] MFA Rules not processed for user `75a7632fe5b5474ab6afd5b3d1bee4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:39:52.493566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-d76165e0-ff7c-4639-9980-901e97199a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:39:52.583429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 460/931] 10.222.0.24 () {58 vars in 1061 bytes} [Sat Jun 4 20:39:52 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:39:52.593181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15eac55-e01c-401e-84be-3b233eb89e86 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:39:52.605838 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15eac55-e01c-401e-84be-3b233eb89e86 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:39:52.611064 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a81e4d-b392-468f-873e-bfb207c23a4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:39:52.611937 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81e4d-b392-468f-873e-bfb207c23a4e service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:52.612208 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81e4d-b392-468f-873e-bfb207c23a4e service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:52.612672 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a81e4d-b392-468f-873e-bfb207c23a4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:52.625511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a81e4d-b392-468f-873e-bfb207c23a4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:39:52.627151 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a81e4d-b392-468f-873e-bfb207c23a4e service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:39:52.641982 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 472/932] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:39:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:39:55.494170 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686823a-6edd-45c0-8b67-da5e7f79bacd None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:55.495418 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686823a-6edd-45c0-8b67-da5e7f79bacd None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:55.495418 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686823a-6edd-45c0-8b67-da5e7f79bacd None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:55.497492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 461/933] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:39:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:39:55.502980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01f65d-0c86-4e2e-a0ed-c60b1d077b47 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:55.503787 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01f65d-0c86-4e2e-a0ed-c60b1d077b47 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:55.503787 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa01f65d-0c86-4e2e-a0ed-c60b1d077b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:55.530531 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-aa01f65d-0c86-4e2e-a0ed-c60b1d077b47 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:39:55.531190 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-aa01f65d-0c86-4e2e-a0ed-c60b1d077b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:39:55.540480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 473/934] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:39:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:39:55.608062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc755b0-30cb-460c-a2f1-afb6b0d01158 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:55.608773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc755b0-30cb-460c-a2f1-afb6b0d01158 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:55.609161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc755b0-30cb-460c-a2f1-afb6b0d01158 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:55.612048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 462/935] 10.222.0.24 () {54 vars in 964 bytes} [Sat Jun 4 20:39:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:39:55.624073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90ea61-07c4-4a04-aa4e-628e56208542 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:55.624561 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90ea61-07c4-4a04-aa4e-628e56208542 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:55.625065 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90ea61-07c4-4a04-aa4e-628e56208542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:55.660277 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-eb90ea61-07c4-4a04-aa4e-628e56208542 None None] MFA Rules not processed for user `75a7632fe5b5474ab6afd5b3d1bee4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:39:55.662529 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-eb90ea61-07c4-4a04-aa4e-628e56208542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:39:55.675122 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 474/936] 10.222.0.24 () {58 vars in 1061 bytes} [Sat Jun 4 20:39:55 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:39:55.691033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc755b0-30cb-460c-a2f1-afb6b0d01158 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:39:55.710204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc755b0-30cb-460c-a2f1-afb6b0d01158 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:39:55.715530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b867e0c-fc7b-4cef-9f9e-0ddf42adef83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:39:55.716360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b867e0c-fc7b-4cef-9f9e-0ddf42adef83 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:55.716978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b867e0c-fc7b-4cef-9f9e-0ddf42adef83 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:55.717329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b867e0c-fc7b-4cef-9f9e-0ddf42adef83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:55.729310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b867e0c-fc7b-4cef-9f9e-0ddf42adef83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:39:55.731149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b867e0c-fc7b-4cef-9f9e-0ddf42adef83 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:39:55.743255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 463/937] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:39:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:39:59.060561 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49d3e-beb1-4468-aabc-4dbe1d22fcae None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:59.061210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49d3e-beb1-4468-aabc-4dbe1d22fcae None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:59.061210 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49d3e-beb1-4468-aabc-4dbe1d22fcae None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:59.062609 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 475/938] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:39:59.068862 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a6f63-7c75-4924-8c60-c2e9ffb4e3ec None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:59.069426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a6f63-7c75-4924-8c60-c2e9ffb4e3ec None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:59.069527 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a6f63-7c75-4924-8c60-c2e9ffb4e3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:59.115950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a27a6f63-7c75-4924-8c60-c2e9ffb4e3ec None None] MFA Rules not processed for user `d2ab45f210bf4b3e95c9f9052c7354eb`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:39:59.117204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a27a6f63-7c75-4924-8c60-c2e9ffb4e3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:39:59.178194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:39:59.222696 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 464/939] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:39:59 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:39:59.269888 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e49d3e-beb1-4468-aabc-4dbe1d22fcae None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:39:59.290310 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e49d3e-beb1-4468-aabc-4dbe1d22fcae None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:39:59.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf56a7b-e5e6-4f71-9759-8bc8f66a0256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:39:59.297794 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf56a7b-e5e6-4f71-9759-8bc8f66a0256 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:39:59.298288 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf56a7b-e5e6-4f71-9759-8bc8f66a0256 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:39:59.298741 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf56a7b-e5e6-4f71-9759-8bc8f66a0256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:39:59.316337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf56a7b-e5e6-4f71-9759-8bc8f66a0256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:39:59.319096 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf56a7b-e5e6-4f71-9759-8bc8f66a0256 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:39:59.336710 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 476/940] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:39:59 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:02.609295 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccbaf7-c616-4be5-af02-2ec75ff192c2 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:02.609853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccbaf7-c616-4be5-af02-2ec75ff192c2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:02.610109 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edccbaf7-c616-4be5-af02-2ec75ff192c2 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:02.611736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 465/941] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:02.619232 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9073c82-b749-4eb4-a425-c76783fe98e9 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:02.620221 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9073c82-b749-4eb4-a425-c76783fe98e9 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:02.620221 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9073c82-b749-4eb4-a425-c76783fe98e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:02.639643 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-c9073c82-b749-4eb4-a425-c76783fe98e9 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:02.640909 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-c9073c82-b749-4eb4-a425-c76783fe98e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:02.723799 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 477/942] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:02 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:40:02.768077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccbaf7-c616-4be5-af02-2ec75ff192c2 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:02.779670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edccbaf7-c616-4be5-af02-2ec75ff192c2 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:02.783120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d3a10-c2be-4e8e-82ed-43e92d6a91e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:02.783784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d3a10-c2be-4e8e-82ed-43e92d6a91e2 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:02.784070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d3a10-c2be-4e8e-82ed-43e92d6a91e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:02.784349 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d3a10-c2be-4e8e-82ed-43e92d6a91e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:02.794219 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d3a10-c2be-4e8e-82ed-43e92d6a91e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:02.795683 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d3a10-c2be-4e8e-82ed-43e92d6a91e2 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:02.805901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 466/943] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:02 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:06.241740 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00180058-6923-41e6-9541-e63e6d76527e None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:06.242585 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00180058-6923-41e6-9541-e63e6d76527e None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:06.242742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00180058-6923-41e6-9541-e63e6d76527e None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:06.244215 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 478/944] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:06.250484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8611a6e-bad6-4d80-97d3-3c85b67952ac None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:06.251268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8611a6e-bad6-4d80-97d3-3c85b67952ac None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:06.251268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8611a6e-bad6-4d80-97d3-3c85b67952ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:06.274015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-d8611a6e-bad6-4d80-97d3-3c85b67952ac None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:06.275275 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-d8611a6e-bad6-4d80-97d3-3c85b67952ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:06.284276 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 467/945] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:06.323323 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00180058-6923-41e6-9541-e63e6d76527e None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:06.334433 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00180058-6923-41e6-9541-e63e6d76527e None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:06.338281 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25c222-07d8-41d9-81de-7f69cb3b55e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:06.339045 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c222-07d8-41d9-81de-7f69cb3b55e6 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:06.339354 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c222-07d8-41d9-81de-7f69cb3b55e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:06.339697 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25c222-07d8-41d9-81de-7f69cb3b55e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:06.351322 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25c222-07d8-41d9-81de-7f69cb3b55e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:06.352947 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25c222-07d8-41d9-81de-7f69cb3b55e6 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:06.364307 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 479/946] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:08.982257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c61d5-04fc-4bbe-ac9f-c8a741b0021c None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:08.982795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c61d5-04fc-4bbe-ac9f-c8a741b0021c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:08.982795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c61d5-04fc-4bbe-ac9f-c8a741b0021c None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:08.984177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 468/947] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:08.991258 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb003-0d80-44ea-abe7-4b7ef1b23a9e None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:08.991835 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb003-0d80-44ea-abe7-4b7ef1b23a9e None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:08.991835 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cb003-0d80-44ea-abe7-4b7ef1b23a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:09.011449 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-bc2cb003-0d80-44ea-abe7-4b7ef1b23a9e None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:09.012688 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-bc2cb003-0d80-44ea-abe7-4b7ef1b23a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:09.021629 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 480/948] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:40:09.068836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c61d5-04fc-4bbe-ac9f-c8a741b0021c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:09.082764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c61d5-04fc-4bbe-ac9f-c8a741b0021c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:09.086666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827335a0-0c08-481e-97a1-6da9c0fdbac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:09.087350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827335a0-0c08-481e-97a1-6da9c0fdbac1 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:09.087711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827335a0-0c08-481e-97a1-6da9c0fdbac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:09.088014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827335a0-0c08-481e-97a1-6da9c0fdbac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:09.099732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827335a0-0c08-481e-97a1-6da9c0fdbac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:09.101598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827335a0-0c08-481e-97a1-6da9c0fdbac1 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:09.114054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 469/949] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:11.693040 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1f59d-d272-4c77-8451-98c7c1a470f8 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:11.693614 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1f59d-d272-4c77-8451-98c7c1a470f8 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:11.693614 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1f59d-d272-4c77-8451-98c7c1a470f8 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:11.694977 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 481/950] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:11.702917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba5cff-70be-4905-b013-ee0a85b3b63f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:11.703440 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba5cff-70be-4905-b013-ee0a85b3b63f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:11.703535 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fba5cff-70be-4905-b013-ee0a85b3b63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:11.726333 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-1fba5cff-70be-4905-b013-ee0a85b3b63f None None] MFA Rules not processed for user `d2ab45f210bf4b3e95c9f9052c7354eb`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:11.727568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-1fba5cff-70be-4905-b013-ee0a85b3b63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:11.737050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 470/951] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:11 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:11.779201 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1f59d-d272-4c77-8451-98c7c1a470f8 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:11.791488 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1f59d-d272-4c77-8451-98c7c1a470f8 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:11.795804 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd927a-5ae9-4e81-a8a8-c5a45c01d3fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:11.796524 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd927a-5ae9-4e81-a8a8-c5a45c01d3fd service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:11.796939 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd927a-5ae9-4e81-a8a8-c5a45c01d3fd service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:11.797222 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd927a-5ae9-4e81-a8a8-c5a45c01d3fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:11.807991 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd927a-5ae9-4e81-a8a8-c5a45c01d3fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:11.809528 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd927a-5ae9-4e81-a8a8-c5a45c01d3fd service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:11.821231 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 482/952] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:11 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:14.625065 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806689db-0e36-4a6d-bae2-1fb677e23e13 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:14.625629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806689db-0e36-4a6d-bae2-1fb677e23e13 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:14.625760 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806689db-0e36-4a6d-bae2-1fb677e23e13 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:14.627301 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 471/953] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:14.634169 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef92f58-df45-4ceb-b104-96362940b5ba None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:14.634820 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef92f58-df45-4ceb-b104-96362940b5ba None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:14.634820 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef92f58-df45-4ceb-b104-96362940b5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:14.654628 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-9ef92f58-df45-4ceb-b104-96362940b5ba None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:14.655841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-9ef92f58-df45-4ceb-b104-96362940b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:14.664291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 483/954] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:14.701887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806689db-0e36-4a6d-bae2-1fb677e23e13 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:14.714404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806689db-0e36-4a6d-bae2-1fb677e23e13 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:14.720270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f26fb-2b7b-4dce-8a78-c3f7c2d664c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:14.720990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f26fb-2b7b-4dce-8a78-c3f7c2d664c2 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:14.721276 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f26fb-2b7b-4dce-8a78-c3f7c2d664c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:14.721549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f26fb-2b7b-4dce-8a78-c3f7c2d664c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:14.733817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f26fb-2b7b-4dce-8a78-c3f7c2d664c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:14.735297 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885f26fb-2b7b-4dce-8a78-c3f7c2d664c2 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:14.746819 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 472/955] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:40:17.285606 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d5885-8555-474d-b95b-86e54bae4ff0 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:17.287544 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d5885-8555-474d-b95b-86e54bae4ff0 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:17.288158 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d5885-8555-474d-b95b-86e54bae4ff0 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:17.290248 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 484/956] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:17.296984 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77f01-60c6-4c26-a7ee-f3dcc772e150 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:17.297650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77f01-60c6-4c26-a7ee-f3dcc772e150 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:17.297650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd77f01-60c6-4c26-a7ee-f3dcc772e150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:17.322429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-ddd77f01-60c6-4c26-a7ee-f3dcc772e150 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:17.324903 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ddd77f01-60c6-4c26-a7ee-f3dcc772e150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:17.336905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 473/957] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:40:17.379389 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d5885-8555-474d-b95b-86e54bae4ff0 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:17.391478 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d5885-8555-474d-b95b-86e54bae4ff0 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:17.395080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd81c1a-b72b-4cd2-aa2f-6bf5b7744681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:17.395743 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd81c1a-b72b-4cd2-aa2f-6bf5b7744681 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:17.396032 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd81c1a-b72b-4cd2-aa2f-6bf5b7744681 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:17.396315 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd81c1a-b72b-4cd2-aa2f-6bf5b7744681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:17.406755 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd81c1a-b72b-4cd2-aa2f-6bf5b7744681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:17.408560 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd81c1a-b72b-4cd2-aa2f-6bf5b7744681 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:17.421181 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 485/958] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:20.374352 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9b3e-3ef7-48d3-b7d4-be4d74770fcb None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:20.374967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9b3e-3ef7-48d3-b7d4-be4d74770fcb None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:20.374967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9b3e-3ef7-48d3-b7d4-be4d74770fcb None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:20.376272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 474/959] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:20.383722 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e4c3-0599-42ff-b840-c8ff57f216f2 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:20.384355 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e4c3-0599-42ff-b840-c8ff57f216f2 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:20.384355 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153e4c3-0599-42ff-b840-c8ff57f216f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:20.404801 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-d153e4c3-0599-42ff-b840-c8ff57f216f2 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:20.406003 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-d153e4c3-0599-42ff-b840-c8ff57f216f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:20.414673 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 486/960] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:20 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:40:20.458220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac9b3e-3ef7-48d3-b7d4-be4d74770fcb None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:20.473993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac9b3e-3ef7-48d3-b7d4-be4d74770fcb None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:20.479148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd713163-d1dc-4806-8acf-a2776487a161 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:20.479824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd713163-d1dc-4806-8acf-a2776487a161 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:20.480109 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd713163-d1dc-4806-8acf-a2776487a161 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:20.480423 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd713163-d1dc-4806-8acf-a2776487a161 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:20.491420 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd713163-d1dc-4806-8acf-a2776487a161 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:20.493086 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd713163-d1dc-4806-8acf-a2776487a161 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:20.504567 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 475/961] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:20 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:25.082411 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736872b-e5ad-40de-bd75-28e4f57157ff None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:25.082964 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736872b-e5ad-40de-bd75-28e4f57157ff None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:25.082964 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736872b-e5ad-40de-bd75-28e4f57157ff None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:25.084292 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 487/962] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:25.090508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38edd62-1f99-4625-922b-cfea5c51c340 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:25.090965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38edd62-1f99-4625-922b-cfea5c51c340 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:25.091074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38edd62-1f99-4625-922b-cfea5c51c340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:25.110091 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e38edd62-1f99-4625-922b-cfea5c51c340 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:25.111294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e38edd62-1f99-4625-922b-cfea5c51c340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:25.120061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 476/963] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:25.160525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736872b-e5ad-40de-bd75-28e4f57157ff None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:25.166498 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=77 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:25.176050 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d736872b-e5ad-40de-bd75-28e4f57157ff None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:25.180051 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3758a-6957-4d62-9134-0427672a4f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:25.180751 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3758a-6957-4d62-9134-0427672a4f8f service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:25.181156 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3758a-6957-4d62-9134-0427672a4f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:25.181444 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3758a-6957-4d62-9134-0427672a4f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:25.191882 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3758a-6957-4d62-9134-0427672a4f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:25.193366 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a3758a-6957-4d62-9134-0427672a4f8f service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:25.204319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 488/964] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:28.354293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bd5bf-8a04-4f87-9b78-883b0049e948 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:28.355028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bd5bf-8a04-4f87-9b78-883b0049e948 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:28.355028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952bd5bf-8a04-4f87-9b78-883b0049e948 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:28.356301 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 477/965] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:28.362204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d6452-46d7-4be5-bb8b-a6a8dd4858e7 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:28.362727 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d6452-46d7-4be5-bb8b-a6a8dd4858e7 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:28.362827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46d6452-46d7-4be5-bb8b-a6a8dd4858e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:28.381297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-b46d6452-46d7-4be5-bb8b-a6a8dd4858e7 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:28.382839 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-b46d6452-46d7-4be5-bb8b-a6a8dd4858e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:28.390988 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 489/966] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:28 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:40:28.428915 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bd5bf-8a04-4f87-9b78-883b0049e948 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:28.443259 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952bd5bf-8a04-4f87-9b78-883b0049e948 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:28.447036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61ec43a-c9b6-4481-82dd-bc5b48162681 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:28.447793 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ec43a-c9b6-4481-82dd-bc5b48162681 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:28.448077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ec43a-c9b6-4481-82dd-bc5b48162681 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:28.448354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61ec43a-c9b6-4481-82dd-bc5b48162681 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:28.458534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ec43a-c9b6-4481-82dd-bc5b48162681 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:28.459937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61ec43a-c9b6-4481-82dd-bc5b48162681 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:28.470959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 478/967] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:28 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:33.159502 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53b59-cdf8-42fc-8c7d-68ccc7dccc3b None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:33.160473 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53b59-cdf8-42fc-8c7d-68ccc7dccc3b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:33.160473 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53b59-cdf8-42fc-8c7d-68ccc7dccc3b None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:33.161379 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 490/968] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:33.167212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8be8-37d9-482f-bf1f-5efe0e01652a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:33.167852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8be8-37d9-482f-bf1f-5efe0e01652a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:33.167852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776c8be8-37d9-482f-bf1f-5efe0e01652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:33.174944 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=54 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:33.189543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-776c8be8-37d9-482f-bf1f-5efe0e01652a None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:33.191081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-776c8be8-37d9-482f-bf1f-5efe0e01652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:33.201312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 479/969] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:33.241540 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d53b59-cdf8-42fc-8c7d-68ccc7dccc3b None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:33.253632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d53b59-cdf8-42fc-8c7d-68ccc7dccc3b None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:33.257553 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e4143-05ca-4af4-8425-4160c837a806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:33.258266 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4143-05ca-4af4-8425-4160c837a806 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:33.258639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4143-05ca-4af4-8425-4160c837a806 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:33.259053 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e4143-05ca-4af4-8425-4160c837a806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:33.268981 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e4143-05ca-4af4-8425-4160c837a806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:33.270520 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6e4143-05ca-4af4-8425-4160c837a806 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:33.281366 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 491/970] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:39.048943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc931729-64e8-4e56-a6a9-bdb9d12f72ff None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:39.050036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc931729-64e8-4e56-a6a9-bdb9d12f72ff None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:39.050575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc931729-64e8-4e56-a6a9-bdb9d12f72ff None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:39.053140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 480/971] 10.222.0.24 () {54 vars in 921 bytes} [Sat Jun 4 20:40:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:39.059873 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765af2-8fc2-4e75-a6d8-9c83484a1b72 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:39.060977 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765af2-8fc2-4e75-a6d8-9c83484a1b72 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:39.061498 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0765af2-8fc2-4e75-a6d8-9c83484a1b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:39.139402 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-e0765af2-8fc2-4e75-a6d8-9c83484a1b72 None None] MFA Rules not processed for user `22f68848269a453289f64d57415fcee5`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:39.140645 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-e0765af2-8fc2-4e75-a6d8-9c83484a1b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:39.225866 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 492/972] 10.222.0.24 () {58 vars in 1018 bytes} [Sat Jun 4 20:40:39 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:40:43.183880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=2 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:43.692737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e3f08-c5fa-41a5-9a91-b4efced1df30 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:43.693179 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e3f08-c5fa-41a5-9a91-b4efced1df30 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:43.693571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e3f08-c5fa-41a5-9a91-b4efced1df30 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:43.695382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 481/973] 10.222.0.24 () {54 vars in 921 bytes} [Sat Jun 4 20:40:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:43.704012 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8a63c-96ce-4650-a85d-fd4d73554104 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:43.704710 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8a63c-96ce-4650-a85d-fd4d73554104 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:43.704710 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a8a63c-96ce-4650-a85d-fd4d73554104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:43.727241 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-52a8a63c-96ce-4650-a85d-fd4d73554104 None None] MFA Rules not processed for user `22f68848269a453289f64d57415fcee5`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:43.729057 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-52a8a63c-96ce-4650-a85d-fd4d73554104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:43.743648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 493/974] 10.222.0.24 () {58 vars in 1018 bytes} [Sat Jun 4 20:40:43 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:45.766756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f954-7866-47c2-b55d-e7237c4f6c0f None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:45.767479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f954-7866-47c2-b55d-e7237c4f6c0f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:45.767479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580f954-7866-47c2-b55d-e7237c4f6c0f None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:45.768730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 482/975] 10.222.0.24 () {54 vars in 921 bytes} [Sat Jun 4 20:40:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:40:45.775327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a7552-a035-47d9-b455-27060b90ac80 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:45.776098 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a7552-a035-47d9-b455-27060b90ac80 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:45.776098 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a7552-a035-47d9-b455-27060b90ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:45.796401 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-9a1a7552-a035-47d9-b455-27060b90ac80 None None] MFA Rules not processed for user `22f68848269a453289f64d57415fcee5`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:45.797653 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-9a1a7552-a035-47d9-b455-27060b90ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:45.807747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 494/976] 10.222.0.24 () {58 vars in 1018 bytes} [Sat Jun 4 20:40:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:49.745666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9487afb-9e9b-40b9-9f5c-1265575c9ce9 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:49.746251 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9487afb-9e9b-40b9-9f5c-1265575c9ce9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:49.746251 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9487afb-9e9b-40b9-9f5c-1265575c9ce9 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:49.748484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 483/977] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:49.755404 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd78b-a14d-4db9-bbe5-1d430cb63af0 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:49.756658 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd78b-a14d-4db9-bbe5-1d430cb63af0 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:49.757249 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd78b-a14d-4db9-bbe5-1d430cb63af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:49.783418 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-105dd78b-a14d-4db9-bbe5-1d430cb63af0 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:49.785052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-105dd78b-a14d-4db9-bbe5-1d430cb63af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:49.799987 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 495/978] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:49.868067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251f8ec-922e-4a49-8d95-46837c3d8b21 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:49.868341 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251f8ec-922e-4a49-8d95-46837c3d8b21 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:49.868663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4251f8ec-922e-4a49-8d95-46837c3d8b21 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:49.877363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 484/979] 10.222.0.24 () {54 vars in 961 bytes} [Sat Jun 4 20:40:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:49.893795 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf292d-d928-4fa8-8f17-ca39a703aa22 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:49.894632 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf292d-d928-4fa8-8f17-ca39a703aa22 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:49.895416 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf292d-d928-4fa8-8f17-ca39a703aa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:49.954014 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-dedf292d-d928-4fa8-8f17-ca39a703aa22 None None] MFA Rules not processed for user `b82d01982ea7412aa396b517ed80bd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:49.955642 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-dedf292d-d928-4fa8-8f17-ca39a703aa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:50.049674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:40:50.058941 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 496/980] 10.222.0.24 () {58 vars in 1058 bytes} [Sat Jun 4 20:40:49 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:50.067492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251f8ec-922e-4a49-8d95-46837c3d8b21 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:50.088411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4251f8ec-922e-4a49-8d95-46837c3d8b21 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:50.096127 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37145a4a-1c09-420f-bd2e-65598f463ccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:50.097289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145a4a-1c09-420f-bd2e-65598f463ccb service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:50.097802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145a4a-1c09-420f-bd2e-65598f463ccb service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:50.098337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37145a4a-1c09-420f-bd2e-65598f463ccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:50.113407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37145a4a-1c09-420f-bd2e-65598f463ccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:50.116242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37145a4a-1c09-420f-bd2e-65598f463ccb service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:50.134949 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 485/981] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:40:52.964683 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648065-22f7-45f6-8775-de7340b3b723 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:52.965300 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648065-22f7-45f6-8775-de7340b3b723 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:52.965399 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648065-22f7-45f6-8775-de7340b3b723 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:52.967263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 497/982] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:52.974335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997cc39-72a5-41e0-b84d-af2269a2ee0b None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:52.974836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997cc39-72a5-41e0-b84d-af2269a2ee0b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:52.974924 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0997cc39-72a5-41e0-b84d-af2269a2ee0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:52.996682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-0997cc39-72a5-41e0-b84d-af2269a2ee0b None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:52.998311 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0997cc39-72a5-41e0-b84d-af2269a2ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:53.028556 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 486/983] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:53.077538 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c648065-22f7-45f6-8775-de7340b3b723 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:53.093105 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c648065-22f7-45f6-8775-de7340b3b723 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:53.098698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ac7b8e-10d7-4c40-9714-3907a61e7279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:53.099507 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac7b8e-10d7-4c40-9714-3907a61e7279 service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:53.099868 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac7b8e-10d7-4c40-9714-3907a61e7279 service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:53.100242 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ac7b8e-10d7-4c40-9714-3907a61e7279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:53.111063 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac7b8e-10d7-4c40-9714-3907a61e7279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:53.112955 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ac7b8e-10d7-4c40-9714-3907a61e7279 service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:53.125310 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 498/984] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:56.069204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618ebce-c7b7-4373-88c1-097b63b1dcd4 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:56.069881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618ebce-c7b7-4373-88c1-097b63b1dcd4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:56.069996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5618ebce-c7b7-4373-88c1-097b63b1dcd4 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:56.072241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 487/985] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:56.079645 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bf610-df97-40fb-ad61-82be1b3395ce None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:56.080335 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bf610-df97-40fb-ad61-82be1b3395ce None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:56.080803 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1bf610-df97-40fb-ad61-82be1b3395ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:56.113151 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-fb1bf610-df97-40fb-ad61-82be1b3395ce None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:56.114701 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-fb1bf610-df97-40fb-ad61-82be1b3395ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:56.129309 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 499/986] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:56.185257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996427d5-c14a-4cda-b324-f6ffc8631d03 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:56.185521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996427d5-c14a-4cda-b324-f6ffc8631d03 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:56.185827 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996427d5-c14a-4cda-b324-f6ffc8631d03 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:56.187450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 488/987] 10.222.0.24 () {54 vars in 961 bytes} [Sat Jun 4 20:40:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:56.194617 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a020cb-238d-4484-9bc8-52c7cfb6f383 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:56.195383 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a020cb-238d-4484-9bc8-52c7cfb6f383 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:56.195960 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a020cb-238d-4484-9bc8-52c7cfb6f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:56.217414 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-c9a020cb-238d-4484-9bc8-52c7cfb6f383 None None] MFA Rules not processed for user `b82d01982ea7412aa396b517ed80bd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:56.218646 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-c9a020cb-238d-4484-9bc8-52c7cfb6f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:56.235954 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 500/988] 10.222.0.24 () {58 vars in 1058 bytes} [Sat Jun 4 20:40:56 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:56.246045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996427d5-c14a-4cda-b324-f6ffc8631d03 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:56.260946 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996427d5-c14a-4cda-b324-f6ffc8631d03 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:56.270823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7ab1b1-d9ed-4b56-9d7f-1f9415b7c17f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:56.271612 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ab1b1-d9ed-4b56-9d7f-1f9415b7c17f service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:56.271926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ab1b1-d9ed-4b56-9d7f-1f9415b7c17f service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:56.272307 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7ab1b1-d9ed-4b56-9d7f-1f9415b7c17f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:56.293482 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ab1b1-d9ed-4b56-9d7f-1f9415b7c17f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:56.293482 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7ab1b1-d9ed-4b56-9d7f-1f9415b7c17f service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:56.303075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 489/989] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:40:58.879816 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b8ee-50ee-4b1f-b564-984804c7c89d None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:58.880763 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b8ee-50ee-4b1f-b564-984804c7c89d None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:58.881547 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3b8ee-50ee-4b1f-b564-984804c7c89d None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:58.887690 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 501/990] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:40:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:40:58.890288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826a0d9-5014-4c8c-b3c1-36d64746deaf None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:58.891155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826a0d9-5014-4c8c-b3c1-36d64746deaf None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:58.891648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826a0d9-5014-4c8c-b3c1-36d64746deaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:58.918596 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-d826a0d9-5014-4c8c-b3c1-36d64746deaf None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:40:58.920200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-d826a0d9-5014-4c8c-b3c1-36d64746deaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:40:58.928975 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 490/991] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:40:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:40:58.976819 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3b8ee-50ee-4b1f-b564-984804c7c89d None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:40:58.991412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3b8ee-50ee-4b1f-b564-984804c7c89d None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:40:58.997050 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc23daa-3513-4804-b2de-735a9d382f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:40:58.997961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc23daa-3513-4804-b2de-735a9d382f48 service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:40:58.998407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc23daa-3513-4804-b2de-735a9d382f48 service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:40:58.998828 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc23daa-3513-4804-b2de-735a9d382f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:40:59.009624 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc23daa-3513-4804-b2de-735a9d382f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:40:59.017001 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc23daa-3513-4804-b2de-735a9d382f48 service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:40:59.040225 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 502/992] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:40:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:01.251798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8e3b-783f-46e3-affb-36384089fd4c None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:01.252358 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8e3b-783f-46e3-affb-36384089fd4c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:01.252358 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e8e3b-783f-46e3-affb-36384089fd4c None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:01.253651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 491/993] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:01.259645 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433735-a797-4fc0-8ecf-8d35141e0006 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:01.260127 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433735-a797-4fc0-8ecf-8d35141e0006 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:01.260406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e433735-a797-4fc0-8ecf-8d35141e0006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:01.279221 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-6e433735-a797-4fc0-8ecf-8d35141e0006 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:01.280422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-6e433735-a797-4fc0-8ecf-8d35141e0006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:01.288283 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 503/994] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:41:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:41:01.540070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4759d67-43e4-45b7-b1bf-25246e7c8cb8 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:01.540322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4759d67-43e4-45b7-b1bf-25246e7c8cb8 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:01.540831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4759d67-43e4-45b7-b1bf-25246e7c8cb8 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:01.542173 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 492/995] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:01.547867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584dff-bc4e-4624-9924-5b212ddd0aba None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:01.548287 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584dff-bc4e-4624-9924-5b212ddd0aba None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:01.548705 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47584dff-bc4e-4624-9924-5b212ddd0aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:01.561263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cda83-fc4c-476b-b4fb-ee6fd2348339 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:01.561550 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cda83-fc4c-476b-b4fb-ee6fd2348339 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:01.561829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cda83-fc4c-476b-b4fb-ee6fd2348339 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:01.563191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 493/996] 10.222.0.24 () {54 vars in 963 bytes} [Sat Jun 4 20:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:41:01.568262 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad34f1-9cbf-4b68-a86d-7665e7ae4d1b None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:01.568590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad34f1-9cbf-4b68-a86d-7665e7ae4d1b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:01.568888 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad34f1-9cbf-4b68-a86d-7665e7ae4d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:01.570076 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-47584dff-bc4e-4624-9924-5b212ddd0aba None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:01.571363 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-47584dff-bc4e-4624-9924-5b212ddd0aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:01.580070 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 504/997] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:41:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:01.614372 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-5aad34f1-9cbf-4b68-a86d-7665e7ae4d1b None None] MFA Rules not processed for user `eea7c50b99044720801876cce86e4311`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:01.617080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-5aad34f1-9cbf-4b68-a86d-7665e7ae4d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:01.629319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584dff-bc4e-4624-9924-5b212ddd0aba None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:01.642410 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47584dff-bc4e-4624-9924-5b212ddd0aba None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:01.648317 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4b2ad-1de7-4813-9875-bbb9d3bb7246 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:01.649526 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b2ad-1de7-4813-9875-bbb9d3bb7246 service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:01.649916 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b2ad-1de7-4813-9875-bbb9d3bb7246 service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:01.650298 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f4b2ad-1de7-4813-9875-bbb9d3bb7246 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:01.659594 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4b2ad-1de7-4813-9875-bbb9d3bb7246 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:01.661881 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f4b2ad-1de7-4813-9875-bbb9d3bb7246 service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:01.672778 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 505/998] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:01.697309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 494/999] 10.222.0.24 () {58 vars in 1060 bytes} [Sat Jun 4 20:41:01 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:41:01.705406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4b2ad-1de7-4813-9875-bbb9d3bb7246 service nova] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:01.716116 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f4b2ad-1de7-4813-9875-bbb9d3bb7246 service nova] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:01.720748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c2371-9a47-4c5c-9d0a-c41a9a060d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea7c50b99044720801876cce86e4311', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:01.721433 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c2371-9a47-4c5c-9d0a-c41a9a060d9c service cinder] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:01.721717 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c2371-9a47-4c5c-9d0a-c41a9a060d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:01.721995 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c2371-9a47-4c5c-9d0a-c41a9a060d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:01.733627 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c2371-9a47-4c5c-9d0a-c41a9a060d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:01.735286 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675c2371-9a47-4c5c-9d0a-c41a9a060d9c service cinder] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:01.752161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 506/1000] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:04.114233 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014985a5-7524-4f32-b628-dbecd4394446 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:04.114643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014985a5-7524-4f32-b628-dbecd4394446 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:04.115086 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014985a5-7524-4f32-b628-dbecd4394446 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:04.116236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 495/1001] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:04.122293 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010077-295d-45eb-8f96-b95e1638a428 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:04.122784 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010077-295d-45eb-8f96-b95e1638a428 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:04.123016 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c010077-295d-45eb-8f96-b95e1638a428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:04.143134 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-8c010077-295d-45eb-8f96-b95e1638a428 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:04.144357 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-8c010077-295d-45eb-8f96-b95e1638a428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:04.153759 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 507/1002] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:41:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:04.200877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014985a5-7524-4f32-b628-dbecd4394446 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:04.216295 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014985a5-7524-4f32-b628-dbecd4394446 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:04.221629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd4d26-32ed-4e0e-be71-328d5ce042e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:04.222287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd4d26-32ed-4e0e-be71-328d5ce042e9 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:04.222571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd4d26-32ed-4e0e-be71-328d5ce042e9 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:04.222849 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd4d26-32ed-4e0e-be71-328d5ce042e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:04.233473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd4d26-32ed-4e0e-be71-328d5ce042e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:04.235233 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd4d26-32ed-4e0e-be71-328d5ce042e9 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:04.247416 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 496/1003] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:06.638336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6879fd-ab62-4dde-bdbb-49b9f4ca26d7 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:06.638899 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6879fd-ab62-4dde-bdbb-49b9f4ca26d7 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:06.638899 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6879fd-ab62-4dde-bdbb-49b9f4ca26d7 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:06.643168 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 508/1004] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:41:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:06.646010 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c51b5-d04b-4049-a7d9-0a86c4b9d08d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:06.646445 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c51b5-d04b-4049-a7d9-0a86c4b9d08d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:06.646548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c51b5-d04b-4049-a7d9-0a86c4b9d08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:06.665411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-3a4c51b5-d04b-4049-a7d9-0a86c4b9d08d None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:06.666621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-3a4c51b5-d04b-4049-a7d9-0a86c4b9d08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:06.675004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 497/1005] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:41:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:06.718815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6879fd-ab62-4dde-bdbb-49b9f4ca26d7 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:06.735743 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6879fd-ab62-4dde-bdbb-49b9f4ca26d7 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:06.742015 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6d6aa-c033-423b-9b74-e3e3e593f692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:06.742899 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6d6aa-c033-423b-9b74-e3e3e593f692 service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:06.743274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6d6aa-c033-423b-9b74-e3e3e593f692 service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:06.743612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6d6aa-c033-423b-9b74-e3e3e593f692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:06.753093 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6d6aa-c033-423b-9b74-e3e3e593f692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:06.754846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6d6aa-c033-423b-9b74-e3e3e593f692 service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:06.766933 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 509/1006] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:09.219423 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4774a-4a1d-40a8-9597-451ecb1cd1d1 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:09.219966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4774a-4a1d-40a8-9597-451ecb1cd1d1 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:09.219966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4774a-4a1d-40a8-9597-451ecb1cd1d1 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:09.222556 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 498/1007] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:41:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:41:09.227221 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e627e1-b490-4431-a042-b96ed4766187 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:09.227747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e627e1-b490-4431-a042-b96ed4766187 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:09.227747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e627e1-b490-4431-a042-b96ed4766187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:09.247943 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-23e627e1-b490-4431-a042-b96ed4766187 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:09.249158 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-23e627e1-b490-4431-a042-b96ed4766187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:09.257805 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 510/1008] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:41:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:09.302713 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4774a-4a1d-40a8-9597-451ecb1cd1d1 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:09.317095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4774a-4a1d-40a8-9597-451ecb1cd1d1 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:09.322717 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9b4c29-0278-4397-8742-cc708481eedb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:09.323367 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b4c29-0278-4397-8742-cc708481eedb service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:09.323651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b4c29-0278-4397-8742-cc708481eedb service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:09.323926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9b4c29-0278-4397-8742-cc708481eedb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:09.332590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b4c29-0278-4397-8742-cc708481eedb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:09.334320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9b4c29-0278-4397-8742-cc708481eedb service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:09.345721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 499/1009] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:11.795755 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04db2-9695-4ac9-ac5f-e5fac6241287 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:11.801367 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04db2-9695-4ac9-ac5f-e5fac6241287 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:11.801367 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb04db2-9695-4ac9-ac5f-e5fac6241287 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:11.801367 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 511/1010] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:41:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:11.804655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86319-1be4-426f-a58c-3636eb2788a8 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:11.805254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86319-1be4-426f-a58c-3636eb2788a8 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:11.805254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b86319-1be4-426f-a58c-3636eb2788a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:11.828597 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-00b86319-1be4-426f-a58c-3636eb2788a8 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:11.830177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-00b86319-1be4-426f-a58c-3636eb2788a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:11.838865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 500/1011] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:41:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:11.887043 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb04db2-9695-4ac9-ac5f-e5fac6241287 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:11.902523 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb04db2-9695-4ac9-ac5f-e5fac6241287 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:11.907521 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb94c065-4a11-431e-a689-7140707807b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:11.908164 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94c065-4a11-431e-a689-7140707807b8 service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:11.908639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94c065-4a11-431e-a689-7140707807b8 service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:11.908753 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb94c065-4a11-431e-a689-7140707807b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:11.917611 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94c065-4a11-431e-a689-7140707807b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:11.919231 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb94c065-4a11-431e-a689-7140707807b8 service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:11.928905 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 512/1012] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:41:14.934177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd9aef-9970-450e-af38-9c1f310c413e None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:14.934177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd9aef-9970-450e-af38-9c1f310c413e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:14.934177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd9aef-9970-450e-af38-9c1f310c413e None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:14.935323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 501/1013] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:41:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:14.943540 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587cb93-c126-4dfa-9f9c-703e2b85c390 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:14.944487 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587cb93-c126-4dfa-9f9c-703e2b85c390 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:14.944881 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587cb93-c126-4dfa-9f9c-703e2b85c390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:14.972568 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-1587cb93-c126-4dfa-9f9c-703e2b85c390 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:14.974610 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-1587cb93-c126-4dfa-9f9c-703e2b85c390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:14.986374 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 513/1014] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:41:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:15.046480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd9aef-9970-450e-af38-9c1f310c413e None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:15.057353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=70 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:41:15.065082 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd9aef-9970-450e-af38-9c1f310c413e None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:15.073353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa9ec3-e3ac-49d7-8df9-c5b90c3dc292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:15.074181 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa9ec3-e3ac-49d7-8df9-c5b90c3dc292 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:15.074539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa9ec3-e3ac-49d7-8df9-c5b90c3dc292 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:15.074880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa9ec3-e3ac-49d7-8df9-c5b90c3dc292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:15.087009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa9ec3-e3ac-49d7-8df9-c5b90c3dc292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:15.089171 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa9ec3-e3ac-49d7-8df9-c5b90c3dc292 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:15.103940 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 502/1015] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:17.678076 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e50fcb-2d95-459b-a26f-bf104f891762 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:17.678856 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e50fcb-2d95-459b-a26f-bf104f891762 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:17.678856 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e50fcb-2d95-459b-a26f-bf104f891762 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:17.680168 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 514/1016] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:17.686208 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6453337-199e-4d42-8f1f-9ce9df8fb1dd None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:17.686891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6453337-199e-4d42-8f1f-9ce9df8fb1dd None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:17.686891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6453337-199e-4d42-8f1f-9ce9df8fb1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:17.706433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-b6453337-199e-4d42-8f1f-9ce9df8fb1dd None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:17.707640 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-b6453337-199e-4d42-8f1f-9ce9df8fb1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:17.716167 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 503/1017] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:41:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:17.765088 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e50fcb-2d95-459b-a26f-bf104f891762 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:17.795613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e50fcb-2d95-459b-a26f-bf104f891762 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:17.804782 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdaf91a-c733-442c-bf63-7201d2ba1a78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:17.805472 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf91a-c733-442c-bf63-7201d2ba1a78 service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:17.805755 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf91a-c733-442c-bf63-7201d2ba1a78 service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:17.806034 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdaf91a-c733-442c-bf63-7201d2ba1a78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:17.817295 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdaf91a-c733-442c-bf63-7201d2ba1a78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:17.818955 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdaf91a-c733-442c-bf63-7201d2ba1a78 service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:17.830469 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 515/1018] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:18.167144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d08e-eeed-4a97-b0a0-cd9c9d873ec2 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:18.167362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d08e-eeed-4a97-b0a0-cd9c9d873ec2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:18.167613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035d08e-eeed-4a97-b0a0-cd9c9d873ec2 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:18.169204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 504/1019] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:18.174714 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f2ed2-03ae-4c73-99b3-f443f2c4a770 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:18.175095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f2ed2-03ae-4c73-99b3-f443f2c4a770 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:18.175464 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186f2ed2-03ae-4c73-99b3-f443f2c4a770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:18.200655 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-186f2ed2-03ae-4c73-99b3-f443f2c4a770 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:18.201871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-186f2ed2-03ae-4c73-99b3-f443f2c4a770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:18.210290 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 516/1020] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:41:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:18.269802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4b7b-d945-44ec-8580-4934d0245c2f None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:18.270071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4b7b-d945-44ec-8580-4934d0245c2f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:18.270358 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8b4b7b-d945-44ec-8580-4934d0245c2f None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:18.271772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 505/1021] 10.222.0.24 () {54 vars in 962 bytes} [Sat Jun 4 20:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:18.277610 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bf144-e684-4d50-82cf-096c5ffb6f58 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:18.277900 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bf144-e684-4d50-82cf-096c5ffb6f58 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:18.278185 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17bf144-e684-4d50-82cf-096c5ffb6f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:18.321966 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-f17bf144-e684-4d50-82cf-096c5ffb6f58 None None] MFA Rules not processed for user `070dbe04e894424f99365e998376144e`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:18.323178 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-f17bf144-e684-4d50-82cf-096c5ffb6f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:18.400456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=100 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:41:18.405842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 517/1022] 10.222.0.24 () {58 vars in 1059 bytes} [Sat Jun 4 20:41:18 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:18.416419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b4b7b-d945-44ec-8580-4934d0245c2f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:18.430879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8b4b7b-d945-44ec-8580-4934d0245c2f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:18.434661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c21e87-569f-4c24-add5-c0ea1773dde2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070dbe04e894424f99365e998376144e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:18.435328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c21e87-569f-4c24-add5-c0ea1773dde2 service glance] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:18.435613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c21e87-569f-4c24-add5-c0ea1773dde2 service glance] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:18.435905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c21e87-569f-4c24-add5-c0ea1773dde2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:18.447670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c21e87-569f-4c24-add5-c0ea1773dde2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:18.449172 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c21e87-569f-4c24-add5-c0ea1773dde2 service glance] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:18.460315 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 506/1023] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:41:20.326526 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b5daf-61f9-49ec-9cd4-f9d96fa8eadb None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:20.327233 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b5daf-61f9-49ec-9cd4-f9d96fa8eadb None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:20.327233 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b5daf-61f9-49ec-9cd4-f9d96fa8eadb None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:20.328771 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 518/1024] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:20.334391 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9d591-4f9e-47a9-8f60-1b682582a8c2 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:20.337871 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9d591-4f9e-47a9-8f60-1b682582a8c2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:20.337871 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c9d591-4f9e-47a9-8f60-1b682582a8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:20.356412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-d8c9d591-4f9e-47a9-8f60-1b682582a8c2 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:20.357659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-d8c9d591-4f9e-47a9-8f60-1b682582a8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:20.375441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 507/1025] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:41:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:20.425917 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b5daf-61f9-49ec-9cd4-f9d96fa8eadb None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:20.443214 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b5daf-61f9-49ec-9cd4-f9d96fa8eadb None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:20.449493 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc277b24-1f4c-4a14-8ea9-fee6ce724731 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:20.450159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc277b24-1f4c-4a14-8ea9-fee6ce724731 service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:20.450441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc277b24-1f4c-4a14-8ea9-fee6ce724731 service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:20.450726 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc277b24-1f4c-4a14-8ea9-fee6ce724731 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:20.461407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc277b24-1f4c-4a14-8ea9-fee6ce724731 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:20.463026 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc277b24-1f4c-4a14-8ea9-fee6ce724731 service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:20.476166 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 519/1026] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:30.348738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=17 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:41:30.469713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=6 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:41:34.006977 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00197-db87-4f56-80a6-39882f144879 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:34.007625 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00197-db87-4f56-80a6-39882f144879 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:34.007625 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f00197-db87-4f56-80a6-39882f144879 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:34.008972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 508/1027] 10.222.0.24 () {54 vars in 918 bytes} [Sat Jun 4 20:41:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:34.014871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fab26-853a-4f6c-8e7f-349e85f9c709 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:34.015421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fab26-853a-4f6c-8e7f-349e85f9c709 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:34.015421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fab26-853a-4f6c-8e7f-349e85f9c709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:34.035142 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-419fab26-853a-4f6c-8e7f-349e85f9c709 None None] MFA Rules not processed for user `22f68848269a453289f64d57415fcee5`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:34.036394 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-419fab26-853a-4f6c-8e7f-349e85f9c709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:34.045419 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 520/1028] 10.222.0.24 () {58 vars in 1015 bytes} [Sat Jun 4 20:41:34 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:34.060463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2aec-83f3-4622-b58d-ab6fb6f29d18 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:34.060720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2aec-83f3-4622-b58d-ab6fb6f29d18 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:34.061029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cf2aec-83f3-4622-b58d-ab6fb6f29d18 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:34.062418 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 509/1029] 10.222.0.24 () {54 vars in 918 bytes} [Sat Jun 4 20:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:34.067570 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d119642-21b3-4f66-b374-5f2900de7713 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:34.067861 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d119642-21b3-4f66-b374-5f2900de7713 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:34.068462 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d119642-21b3-4f66-b374-5f2900de7713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:34.090441 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-0d119642-21b3-4f66-b374-5f2900de7713 None None] MFA Rules not processed for user `b82d01982ea7412aa396b517ed80bd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:34.091668 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-0d119642-21b3-4f66-b374-5f2900de7713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:34.101986 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 521/1030] 10.222.0.24 () {58 vars in 1015 bytes} [Sat Jun 4 20:41:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:37.300571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366079e-41eb-45e8-9ec2-4ebffc27597a None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:37.301139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366079e-41eb-45e8-9ec2-4ebffc27597a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:37.301139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366079e-41eb-45e8-9ec2-4ebffc27597a None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:37.302487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 510/1031] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:37.308062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cad9c8-736e-42e2-ac59-2beb055fad43 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:37.308541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cad9c8-736e-42e2-ac59-2beb055fad43 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:37.308651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cad9c8-736e-42e2-ac59-2beb055fad43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:37.328410 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-84cad9c8-736e-42e2-ac59-2beb055fad43 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:37.329675 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-84cad9c8-736e-42e2-ac59-2beb055fad43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:37.339051 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 522/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:41:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:37.384785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366079e-41eb-45e8-9ec2-4ebffc27597a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:37.399855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366079e-41eb-45e8-9ec2-4ebffc27597a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:37.406720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f94ffd-75b6-4127-bdcb-395f379e590f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:37.407740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94ffd-75b6-4127-bdcb-395f379e590f service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:37.408206 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94ffd-75b6-4127-bdcb-395f379e590f service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:37.408695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f94ffd-75b6-4127-bdcb-395f379e590f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:37.420023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f94ffd-75b6-4127-bdcb-395f379e590f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:37.421705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f94ffd-75b6-4127-bdcb-395f379e590f service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:37.432669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 511/1033] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:38.492167 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9393f42-c5c5-43c4-9529-fba88176a1ae None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:38.492831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9393f42-c5c5-43c4-9529-fba88176a1ae None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:38.492831 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9393f42-c5c5-43c4-9529-fba88176a1ae None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:38.494138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 523/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:38.499243 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b1862-33a5-41bf-a0f0-367a9e6aa2b3 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:38.499720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b1862-33a5-41bf-a0f0-367a9e6aa2b3 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:38.499823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b1862-33a5-41bf-a0f0-367a9e6aa2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:38.519622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-0e6b1862-33a5-41bf-a0f0-367a9e6aa2b3 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:38.520914 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0e6b1862-33a5-41bf-a0f0-367a9e6aa2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:38.529581 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 512/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:41:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:38.725024 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9393f42-c5c5-43c4-9529-fba88176a1ae None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:38.740472 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9393f42-c5c5-43c4-9529-fba88176a1ae None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:38.746112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef66d9a-8809-49c0-aca5-f198e28c5985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:38.746696 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef66d9a-8809-49c0-aca5-f198e28c5985 service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:38.746984 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef66d9a-8809-49c0-aca5-f198e28c5985 service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:38.747262 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef66d9a-8809-49c0-aca5-f198e28c5985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:38.756493 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef66d9a-8809-49c0-aca5-f198e28c5985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:38.758108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef66d9a-8809-49c0-aca5-f198e28c5985 service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:38.767885 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 524/1036] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:39.738326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92da3f-3cd4-4825-a2aa-2160de0dfc33 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:39.738925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92da3f-3cd4-4825-a2aa-2160de0dfc33 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:39.738925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92da3f-3cd4-4825-a2aa-2160de0dfc33 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:39.740264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 513/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:39.745675 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e6452-69ea-472c-a8e9-7dd4cc0e3e95 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:39.746108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e6452-69ea-472c-a8e9-7dd4cc0e3e95 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:39.746237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e6452-69ea-472c-a8e9-7dd4cc0e3e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:39.766078 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-5a9e6452-69ea-472c-a8e9-7dd4cc0e3e95 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:39.767291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-5a9e6452-69ea-472c-a8e9-7dd4cc0e3e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:39.776260 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 525/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:41:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:39.928708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92da3f-3cd4-4825-a2aa-2160de0dfc33 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:39.943671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92da3f-3cd4-4825-a2aa-2160de0dfc33 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:39.949424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4067fd8-a4cf-4a5d-9119-50985daa55da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:39.950070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067fd8-a4cf-4a5d-9119-50985daa55da service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:39.950357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067fd8-a4cf-4a5d-9119-50985daa55da service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:39.950625 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4067fd8-a4cf-4a5d-9119-50985daa55da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:39.959349 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4067fd8-a4cf-4a5d-9119-50985daa55da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:39.960985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4067fd8-a4cf-4a5d-9119-50985daa55da service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:39.970730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 514/1039] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:40.890384 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e4aa-050f-4158-bb1d-a6ecf146e71e None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:40.890959 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e4aa-050f-4158-bb1d-a6ecf146e71e None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:40.890959 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71e4aa-050f-4158-bb1d-a6ecf146e71e None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:40.892214 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 526/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:40.897797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472fcec-0c9f-4303-b325-bd718d3530fc None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:40.898287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472fcec-0c9f-4303-b325-bd718d3530fc None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:40.898287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472fcec-0c9f-4303-b325-bd718d3530fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:40.916685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-d472fcec-0c9f-4303-b325-bd718d3530fc None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:40.917895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-d472fcec-0c9f-4303-b325-bd718d3530fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:40.926095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 515/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:41:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:41:41.077117 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e4aa-050f-4158-bb1d-a6ecf146e71e None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:41.091490 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71e4aa-050f-4158-bb1d-a6ecf146e71e None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:41.097838 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1385ba-6cb3-4f8a-b329-291fe9acb09e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:41.098501 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1385ba-6cb3-4f8a-b329-291fe9acb09e service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:41.098788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1385ba-6cb3-4f8a-b329-291fe9acb09e service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:41.099167 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1385ba-6cb3-4f8a-b329-291fe9acb09e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:41.109284 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1385ba-6cb3-4f8a-b329-291fe9acb09e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:41.110894 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1385ba-6cb3-4f8a-b329-291fe9acb09e service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:41.121433 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 527/1042] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:42.054866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5953e8-32a9-4b96-a6d7-abdfdb835b9f None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:42.055538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5953e8-32a9-4b96-a6d7-abdfdb835b9f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:42.055538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5953e8-32a9-4b96-a6d7-abdfdb835b9f None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:42.056823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 516/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:42.062018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7380d-6cc0-4363-a2c2-36067574111f None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:42.062859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7380d-6cc0-4363-a2c2-36067574111f None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:42.062859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7380d-6cc0-4363-a2c2-36067574111f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:42.081674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-53e7380d-6cc0-4363-a2c2-36067574111f None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:42.082947 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-53e7380d-6cc0-4363-a2c2-36067574111f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:42.091470 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 528/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:41:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:42.245379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5953e8-32a9-4b96-a6d7-abdfdb835b9f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:42.267830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5953e8-32a9-4b96-a6d7-abdfdb835b9f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:42.274393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af03d4-9e24-4f46-bb78-2fea30ce419c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:42.275046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af03d4-9e24-4f46-bb78-2fea30ce419c service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:42.275330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af03d4-9e24-4f46-bb78-2fea30ce419c service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:42.275612 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af03d4-9e24-4f46-bb78-2fea30ce419c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:42.284456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af03d4-9e24-4f46-bb78-2fea30ce419c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:42.286074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af03d4-9e24-4f46-bb78-2fea30ce419c service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:42.296311 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 517/1045] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:43.193934 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360044-6d4a-43dc-bb4f-d4d0b6435520 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:43.194586 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360044-6d4a-43dc-bb4f-d4d0b6435520 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:43.194586 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b360044-6d4a-43dc-bb4f-d4d0b6435520 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:43.195867 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 529/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:41:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:43.201814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a8f53-6313-4e32-a23d-c2137624caf3 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:43.202334 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a8f53-6313-4e32-a23d-c2137624caf3 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:43.202657 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91a8f53-6313-4e32-a23d-c2137624caf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:43.222495 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f91a8f53-6313-4e32-a23d-c2137624caf3 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:43.223845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f91a8f53-6313-4e32-a23d-c2137624caf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:43.232746 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 518/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:41:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:43.396204 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b360044-6d4a-43dc-bb4f-d4d0b6435520 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:43.418859 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b360044-6d4a-43dc-bb4f-d4d0b6435520 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:43.426558 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7388dae9-c2cd-4802-b0de-567a2c74de1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:43.427429 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388dae9-c2cd-4802-b0de-567a2c74de1b service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:43.427710 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388dae9-c2cd-4802-b0de-567a2c74de1b service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:43.427986 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7388dae9-c2cd-4802-b0de-567a2c74de1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:43.437321 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388dae9-c2cd-4802-b0de-567a2c74de1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:43.438934 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7388dae9-c2cd-4802-b0de-567a2c74de1b service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:43.448924 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 530/1048] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:44.309865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ed2a-3b1a-4dcf-8e87-33e15694bccc None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:44.310468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ed2a-3b1a-4dcf-8e87-33e15694bccc None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:44.310468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb5ed2a-3b1a-4dcf-8e87-33e15694bccc None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:44.311805 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 519/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:44.317162 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a9578-b838-453c-803b-0485a8e329fd None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:44.317731 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a9578-b838-453c-803b-0485a8e329fd None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:44.317843 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a9578-b838-453c-803b-0485a8e329fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:44.339207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-dd3a9578-b838-453c-803b-0485a8e329fd None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:44.340577 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-dd3a9578-b838-453c-803b-0485a8e329fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:44.349346 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 531/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:41:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:44.504268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5ed2a-3b1a-4dcf-8e87-33e15694bccc None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:44.519772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb5ed2a-3b1a-4dcf-8e87-33e15694bccc None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:44.525637 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa77d77-c6fc-47b0-b033-e439f7b077b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:44.526308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa77d77-c6fc-47b0-b033-e439f7b077b0 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:44.526597 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa77d77-c6fc-47b0-b033-e439f7b077b0 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:44.526872 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa77d77-c6fc-47b0-b033-e439f7b077b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:44.536488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa77d77-c6fc-47b0-b033-e439f7b077b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:44.537920 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa77d77-c6fc-47b0-b033-e439f7b077b0 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:44.548046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 520/1051] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:45.439130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda78275-5131-4148-af3e-96649f482c90 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:45.439846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda78275-5131-4148-af3e-96649f482c90 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:45.439846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda78275-5131-4148-af3e-96649f482c90 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:45.441052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 532/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:45.446802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661a8b6-2a6a-4dc6-81eb-6e55b3f9b5ba None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:45.447362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661a8b6-2a6a-4dc6-81eb-6e55b3f9b5ba None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:45.447362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661a8b6-2a6a-4dc6-81eb-6e55b3f9b5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:45.472485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-b661a8b6-2a6a-4dc6-81eb-6e55b3f9b5ba None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:45.473766 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-b661a8b6-2a6a-4dc6-81eb-6e55b3f9b5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:45.483064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 521/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:41:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:45.640356 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda78275-5131-4148-af3e-96649f482c90 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:45.657108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda78275-5131-4148-af3e-96649f482c90 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:45.662973 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb36ec-3c05-4728-9bf2-cdf4530ad547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:45.663631 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb36ec-3c05-4728-9bf2-cdf4530ad547 service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:45.663918 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb36ec-3c05-4728-9bf2-cdf4530ad547 service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:45.664194 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb36ec-3c05-4728-9bf2-cdf4530ad547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:45.673645 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb36ec-3c05-4728-9bf2-cdf4530ad547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:45.675264 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb36ec-3c05-4728-9bf2-cdf4530ad547 service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:45.686412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 533/1054] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:46.552632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652b616-bc8a-43d5-8db2-bbade3608727 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:46.553233 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652b616-bc8a-43d5-8db2-bbade3608727 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:46.553233 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652b616-bc8a-43d5-8db2-bbade3608727 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:46.554632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 522/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:46.559961 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5458299-1782-4934-90eb-54c69b34d9f5 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:46.560422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5458299-1782-4934-90eb-54c69b34d9f5 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:46.560595 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5458299-1782-4934-90eb-54c69b34d9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:46.582558 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-d5458299-1782-4934-90eb-54c69b34d9f5 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:46.584094 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-d5458299-1782-4934-90eb-54c69b34d9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:46.593009 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 534/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:41:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:46.745971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652b616-bc8a-43d5-8db2-bbade3608727 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:46.761795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652b616-bc8a-43d5-8db2-bbade3608727 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:46.767778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b10469a-2a6b-4ebf-8b66-cda51390467f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:46.768463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10469a-2a6b-4ebf-8b66-cda51390467f service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:46.768756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10469a-2a6b-4ebf-8b66-cda51390467f service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:46.769029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b10469a-2a6b-4ebf-8b66-cda51390467f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:46.779296 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10469a-2a6b-4ebf-8b66-cda51390467f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:46.780882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b10469a-2a6b-4ebf-8b66-cda51390467f service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:46.791813 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 523/1057] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:48.963130 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194734-aa73-4e2a-9cd7-e68dda6b76c0 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:48.963689 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194734-aa73-4e2a-9cd7-e68dda6b76c0 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:48.963689 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a194734-aa73-4e2a-9cd7-e68dda6b76c0 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:48.965122 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 535/1058] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:48.971130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec9a4-9762-4178-86c2-0aec3019489c None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:48.971566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec9a4-9762-4178-86c2-0aec3019489c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:48.971687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ec9a4-9762-4178-86c2-0aec3019489c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:48.991433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f96ec9a4-9762-4178-86c2-0aec3019489c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:48.992698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f96ec9a4-9762-4178-86c2-0aec3019489c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:49.001862 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 524/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:41:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:49.042189 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a194734-aa73-4e2a-9cd7-e68dda6b76c0 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:49.054796 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a194734-aa73-4e2a-9cd7-e68dda6b76c0 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:49.058801 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d7bb2-edf9-4343-a183-83c34ed0a56f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:49.059452 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7bb2-edf9-4343-a183-83c34ed0a56f service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:49.059735 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7bb2-edf9-4343-a183-83c34ed0a56f service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:49.060010 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d7bb2-edf9-4343-a183-83c34ed0a56f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:49.070237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d7bb2-edf9-4343-a183-83c34ed0a56f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:49.071678 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183d7bb2-edf9-4343-a183-83c34ed0a56f service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:49.081357 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 536/1060] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:51.637396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8189e2b-b644-4dfa-ab08-1ec0c4bd1a25 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:51.638039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8189e2b-b644-4dfa-ab08-1ec0c4bd1a25 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:51.638039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8189e2b-b644-4dfa-ab08-1ec0c4bd1a25 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:51.639486 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 525/1061] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:51.645809 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9907e-d1c5-468d-88dc-b66c798dc7fd None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:51.646364 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9907e-d1c5-468d-88dc-b66c798dc7fd None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:51.646364 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9907e-d1c5-468d-88dc-b66c798dc7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:51.666479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-7bf9907e-d1c5-468d-88dc-b66c798dc7fd None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:51.667735 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-7bf9907e-d1c5-468d-88dc-b66c798dc7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:51.676029 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 537/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:41:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:51.721719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8189e2b-b644-4dfa-ab08-1ec0c4bd1a25 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:51.732911 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8189e2b-b644-4dfa-ab08-1ec0c4bd1a25 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:51.736584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a52e08-1711-45d0-a101-7b103caede31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:51.737242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a52e08-1711-45d0-a101-7b103caede31 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:51.737527 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a52e08-1711-45d0-a101-7b103caede31 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:51.737879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a52e08-1711-45d0-a101-7b103caede31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:51.748620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a52e08-1711-45d0-a101-7b103caede31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:51.750107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a52e08-1711-45d0-a101-7b103caede31 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:51.761792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 526/1063] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:54.599829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c58eb1-e5a7-49cb-a93c-02efd306b142 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:54.600611 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c58eb1-e5a7-49cb-a93c-02efd306b142 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:54.600611 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c58eb1-e5a7-49cb-a93c-02efd306b142 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:54.601889 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 538/1064] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:54.608389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b1a03-7242-4dca-a52a-736eeafe82df None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:54.609020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b1a03-7242-4dca-a52a-736eeafe82df None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:54.609145 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b1a03-7242-4dca-a52a-736eeafe82df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:54.628992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c03b1a03-7242-4dca-a52a-736eeafe82df None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:54.630767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c03b1a03-7242-4dca-a52a-736eeafe82df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:54.640028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 527/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:41:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:54.680004 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c58eb1-e5a7-49cb-a93c-02efd306b142 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:54.692263 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c58eb1-e5a7-49cb-a93c-02efd306b142 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:54.696648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ac9ed-e45f-493d-97fe-d512cbdc0d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:54.697314 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ac9ed-e45f-493d-97fe-d512cbdc0d9e service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:54.697604 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ac9ed-e45f-493d-97fe-d512cbdc0d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:54.697881 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ac9ed-e45f-493d-97fe-d512cbdc0d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:54.708770 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ac9ed-e45f-493d-97fe-d512cbdc0d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:54.710243 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ac9ed-e45f-493d-97fe-d512cbdc0d9e service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:54.721161 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 539/1066] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:41:57.315597 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56320b7c-163a-4d9c-8cad-be0c94f23d94 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:57.316405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56320b7c-163a-4d9c-8cad-be0c94f23d94 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:57.316405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56320b7c-163a-4d9c-8cad-be0c94f23d94 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:57.318259 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 528/1067] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:57.324484 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209b434-5cd0-4f5e-8e53-bf5d91f49b1e None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:57.325029 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209b434-5cd0-4f5e-8e53-bf5d91f49b1e None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:57.325029 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209b434-5cd0-4f5e-8e53-bf5d91f49b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:57.344352 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-a209b434-5cd0-4f5e-8e53-bf5d91f49b1e None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:57.345652 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-a209b434-5cd0-4f5e-8e53-bf5d91f49b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:41:57.354970 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 540/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:41:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:41:57.397764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56320b7c-163a-4d9c-8cad-be0c94f23d94 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:41:57.410829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56320b7c-163a-4d9c-8cad-be0c94f23d94 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:41:57.415690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4850b0ec-ff5c-4d8b-ba92-16d41c02e9bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:41:57.416413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850b0ec-ff5c-4d8b-ba92-16d41c02e9bc service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:57.416792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850b0ec-ff5c-4d8b-ba92-16d41c02e9bc service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:57.417104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4850b0ec-ff5c-4d8b-ba92-16d41c02e9bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:57.428481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850b0ec-ff5c-4d8b-ba92-16d41c02e9bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:41:57.429982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4850b0ec-ff5c-4d8b-ba92-16d41c02e9bc service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:41:57.441057 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 529/1069] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:41:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:41:59.968747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac913f-2e96-479d-ba9b-1e21d82fcc55 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:59.969350 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac913f-2e96-479d-ba9b-1e21d82fcc55 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:59.969512 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edac913f-2e96-479d-ba9b-1e21d82fcc55 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:59.971213 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 541/1070] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:41:59.977758 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36b252-2209-468d-92b5-42504df78533 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:41:59.978292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36b252-2209-468d-92b5-42504df78533 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:41:59.978292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36b252-2209-468d-92b5-42504df78533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:41:59.998725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-8f36b252-2209-468d-92b5-42504df78533 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:41:59.999984 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-8f36b252-2209-468d-92b5-42504df78533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:00.010031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 530/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:41:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:00.050561 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac913f-2e96-479d-ba9b-1e21d82fcc55 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:00.063106 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edac913f-2e96-479d-ba9b-1e21d82fcc55 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:00.067568 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14dd61-d4d0-47ee-a7de-6aef8ba11b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:00.068257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14dd61-d4d0-47ee-a7de-6aef8ba11b3c service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:00.068577 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14dd61-d4d0-47ee-a7de-6aef8ba11b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:00.068857 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14dd61-d4d0-47ee-a7de-6aef8ba11b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:00.079685 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14dd61-d4d0-47ee-a7de-6aef8ba11b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:00.081177 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14dd61-d4d0-47ee-a7de-6aef8ba11b3c service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:00.092804 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 542/1072] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:02.676013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877de2f-75f9-4553-aed1-4a53b146ca26 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:02.676680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877de2f-75f9-4553-aed1-4a53b146ca26 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:02.676798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877de2f-75f9-4553-aed1-4a53b146ca26 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:02.678271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 531/1073] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:42:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:02.684512 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a689-05c1-4a80-a33f-541516462ca5 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:02.685072 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a689-05c1-4a80-a33f-541516462ca5 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:02.685072 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880a689-05c1-4a80-a33f-541516462ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:02.692122 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=70 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:02.707576 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-f880a689-05c1-4a80-a33f-541516462ca5 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:02.708977 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-f880a689-05c1-4a80-a33f-541516462ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:02.717811 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 543/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:42:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:02.758683 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877de2f-75f9-4553-aed1-4a53b146ca26 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:02.764914 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=64 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:02.773188 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877de2f-75f9-4553-aed1-4a53b146ca26 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:02.776885 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302df6c2-d839-4b59-af13-1d4eafe3fcb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:02.777558 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302df6c2-d839-4b59-af13-1d4eafe3fcb1 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:02.777838 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302df6c2-d839-4b59-af13-1d4eafe3fcb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:02.778107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302df6c2-d839-4b59-af13-1d4eafe3fcb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:02.788886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302df6c2-d839-4b59-af13-1d4eafe3fcb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:02.790464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302df6c2-d839-4b59-af13-1d4eafe3fcb1 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:02.801089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 532/1075] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:05.250409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f5143-5efb-4d20-849d-20c7a3320848 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:05.251030 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f5143-5efb-4d20-849d-20c7a3320848 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:05.251137 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f5143-5efb-4d20-849d-20c7a3320848 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:05.252704 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 544/1076] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:05.259099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4eb15-19c9-47ba-8551-cc00be17334f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:05.259606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4eb15-19c9-47ba-8551-cc00be17334f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:05.259755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4eb15-19c9-47ba-8551-cc00be17334f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:05.279249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-d1e4eb15-19c9-47ba-8551-cc00be17334f None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:05.280547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-d1e4eb15-19c9-47ba-8551-cc00be17334f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:05.289856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 533/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:42:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:05.329497 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f5143-5efb-4d20-849d-20c7a3320848 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:05.342525 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f5143-5efb-4d20-849d-20c7a3320848 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:05.346614 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4742fdd-6603-409d-be1d-75eb7a3b5f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:05.347276 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4742fdd-6603-409d-be1d-75eb7a3b5f79 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:05.347562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4742fdd-6603-409d-be1d-75eb7a3b5f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:05.347918 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4742fdd-6603-409d-be1d-75eb7a3b5f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:05.358004 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4742fdd-6603-409d-be1d-75eb7a3b5f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:05.359456 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4742fdd-6603-409d-be1d-75eb7a3b5f79 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:05.369864 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 545/1078] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:07.757842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf7beb-930e-4fcd-b63f-acd7b5ba5b42 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:07.758455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf7beb-930e-4fcd-b63f-acd7b5ba5b42 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:07.758455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cf7beb-930e-4fcd-b63f-acd7b5ba5b42 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:07.759877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 534/1079] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:07.766848 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93cbd-604b-46a3-b7c2-e27454e7422e None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:07.767407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93cbd-604b-46a3-b7c2-e27454e7422e None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:07.767407 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93cbd-604b-46a3-b7c2-e27454e7422e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:07.787017 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-3cd93cbd-604b-46a3-b7c2-e27454e7422e None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:07.788170 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-3cd93cbd-604b-46a3-b7c2-e27454e7422e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:07.797448 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 546/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:42:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:07.838324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf7beb-930e-4fcd-b63f-acd7b5ba5b42 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:07.850282 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cf7beb-930e-4fcd-b63f-acd7b5ba5b42 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:07.854905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b099fd-75cf-404f-bbf4-4ba5565a5e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:07.855596 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b099fd-75cf-404f-bbf4-4ba5565a5e6a service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:07.855888 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b099fd-75cf-404f-bbf4-4ba5565a5e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:07.856169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b099fd-75cf-404f-bbf4-4ba5565a5e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:07.867686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b099fd-75cf-404f-bbf4-4ba5565a5e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:07.869217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b099fd-75cf-404f-bbf4-4ba5565a5e6a service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:07.881492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 535/1081] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:10.269096 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd78e92-11cf-4949-854b-ee9550cfb060 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:10.269879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd78e92-11cf-4949-854b-ee9550cfb060 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:10.270206 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd78e92-11cf-4949-854b-ee9550cfb060 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:10.271602 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 547/1082] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:42:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:10.277659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d77eb0-4b62-4dc0-b7b4-6ce522ee90c2 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:10.278217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d77eb0-4b62-4dc0-b7b4-6ce522ee90c2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:10.278331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d77eb0-4b62-4dc0-b7b4-6ce522ee90c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:10.296935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c7d77eb0-4b62-4dc0-b7b4-6ce522ee90c2 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:10.298156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c7d77eb0-4b62-4dc0-b7b4-6ce522ee90c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:10.307900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 536/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:42:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:10.346100 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd78e92-11cf-4949-854b-ee9550cfb060 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:10.360252 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd78e92-11cf-4949-854b-ee9550cfb060 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:10.363947 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e7178-0eaf-45ab-a896-1e846af91868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:10.364652 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7178-0eaf-45ab-a896-1e846af91868 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:10.364940 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7178-0eaf-45ab-a896-1e846af91868 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:10.365220 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7178-0eaf-45ab-a896-1e846af91868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:10.375232 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e7178-0eaf-45ab-a896-1e846af91868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:10.376710 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e7178-0eaf-45ab-a896-1e846af91868 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:10.387177 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 548/1084] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:12.791713 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e8143-62f6-4f84-b7bd-290091e72d8b None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:12.792255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e8143-62f6-4f84-b7bd-290091e72d8b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:12.792255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e8143-62f6-4f84-b7bd-290091e72d8b None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:12.793599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 537/1085] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:12.799262 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfb32-40df-486d-8346-c01ad8502559 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:12.799742 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfb32-40df-486d-8346-c01ad8502559 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:12.799911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfb32-40df-486d-8346-c01ad8502559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:12.819573 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-6d1bfb32-40df-486d-8346-c01ad8502559 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:12.820851 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-6d1bfb32-40df-486d-8346-c01ad8502559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:12.830452 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 549/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:42:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:12.871270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e8143-62f6-4f84-b7bd-290091e72d8b None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:12.883797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e8143-62f6-4f84-b7bd-290091e72d8b None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:12.887639 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813422c1-64e4-427c-addb-3f14ec66e563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:12.888310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813422c1-64e4-427c-addb-3f14ec66e563 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:12.888631 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813422c1-64e4-427c-addb-3f14ec66e563 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:12.888936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813422c1-64e4-427c-addb-3f14ec66e563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:12.899040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813422c1-64e4-427c-addb-3f14ec66e563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:12.900539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813422c1-64e4-427c-addb-3f14ec66e563 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:12.910894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 538/1087] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:22.813555 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=20 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:22.906117 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=23 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:42:46.292457 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef755fd-ee60-4de9-8597-28403c130d70 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:46.293111 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef755fd-ee60-4de9-8597-28403c130d70 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:46.293111 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef755fd-ee60-4de9-8597-28403c130d70 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:46.294537 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 550/1088] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:46.301667 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfcd75-2a90-4bc4-87ca-8705cdcc7b5f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:46.302620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfcd75-2a90-4bc4-87ca-8705cdcc7b5f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:46.302620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bfcd75-2a90-4bc4-87ca-8705cdcc7b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:46.322846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e0bfcd75-2a90-4bc4-87ca-8705cdcc7b5f None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:46.324115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e0bfcd75-2a90-4bc4-87ca-8705cdcc7b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:46.332840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 539/1089] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:42:46.389479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9a06-5b6d-4619-8052-32b5f5b87589 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:46.389770 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9a06-5b6d-4619-8052-32b5f5b87589 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:46.390052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf9a06-5b6d-4619-8052-32b5f5b87589 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:46.391499 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 551/1090] 10.222.0.24 () {54 vars in 962 bytes} [Sat Jun 4 20:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:46.398234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969618-200b-4e87-8714-1aba918cda3b None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:46.398511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969618-200b-4e87-8714-1aba918cda3b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:46.398778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969618-200b-4e87-8714-1aba918cda3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:46.419647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-b2969618-200b-4e87-8714-1aba918cda3b None None] MFA Rules not processed for user `070dbe04e894424f99365e998376144e`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:46.420958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-b2969618-200b-4e87-8714-1aba918cda3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:46.428804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 540/1091] 10.222.0.24 () {58 vars in 1059 bytes} [Sat Jun 4 20:42:46 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:46.436647 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9a06-5b6d-4619-8052-32b5f5b87589 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:46.448258 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf9a06-5b6d-4619-8052-32b5f5b87589 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:46.451874 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7dc84-3be2-4ab8-984c-15910246ba6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070dbe04e894424f99365e998376144e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:46.452572 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7dc84-3be2-4ab8-984c-15910246ba6e service glance] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:46.452862 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7dc84-3be2-4ab8-984c-15910246ba6e service glance] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:46.453132 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7dc84-3be2-4ab8-984c-15910246ba6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:46.463544 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7dc84-3be2-4ab8-984c-15910246ba6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:46.465054 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7dc84-3be2-4ab8-984c-15910246ba6e service glance] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:46.476257 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 552/1092] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:49.102848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa2c97-0f61-4b8e-83b8-e7e4a5347119 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:49.103462 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa2c97-0f61-4b8e-83b8-e7e4a5347119 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:49.103462 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa2c97-0f61-4b8e-83b8-e7e4a5347119 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:49.104857 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 541/1093] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:49.110630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d306f-0029-45f4-97fb-f2a67067468b None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:49.111197 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d306f-0029-45f4-97fb-f2a67067468b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:49.111287 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d306f-0029-45f4-97fb-f2a67067468b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:49.131306 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-ea0d306f-0029-45f4-97fb-f2a67067468b None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:49.132594 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-ea0d306f-0029-45f4-97fb-f2a67067468b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:49.141419 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 553/1094] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:49.168019 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa2c97-0f61-4b8e-83b8-e7e4a5347119 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:49.182729 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa2c97-0f61-4b8e-83b8-e7e4a5347119 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:49.188015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee8206-4d38-4b44-a3f1-75de6442ba50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:49.188739 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee8206-4d38-4b44-a3f1-75de6442ba50 admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:49.189388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee8206-4d38-4b44-a3f1-75de6442ba50 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:49.189737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee8206-4d38-4b44-a3f1-75de6442ba50 admin admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:49.190570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee8206-4d38-4b44-a3f1-75de6442ba50 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:49.192543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-a4ee8206-4d38-4b44-a3f1-75de6442ba50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:42:49.192543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jun 04 20:42:49.192543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jun 04 20:42:49.196831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee8206-4d38-4b44-a3f1-75de6442ba50 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:49.216811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 542/1095] 10.222.0.24 () {56 vars in 1108 bytes} [Sat Jun 4 20:42:49 2022] GET /identity/v3/projects => generated 1606 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:42:51.731172 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4395a-eff6-40a2-9873-986182c562f2 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:51.731799 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4395a-eff6-40a2-9873-986182c562f2 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:51.731799 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4395a-eff6-40a2-9873-986182c562f2 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:51.733325 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 554/1096] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:51.740048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffc8f6-0220-4bc3-b451-f7578d46730a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:51.740704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffc8f6-0220-4bc3-b451-f7578d46730a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:51.740704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffc8f6-0220-4bc3-b451-f7578d46730a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:51.760488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-07ffc8f6-0220-4bc3-b451-f7578d46730a None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:51.761748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-07ffc8f6-0220-4bc3-b451-f7578d46730a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:51.770734 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 543/1097] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:42:51.842673 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4395a-eff6-40a2-9873-986182c562f2 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:51.865677 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4395a-eff6-40a2-9873-986182c562f2 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:51.874106 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1366545c-26ca-4fd6-90e1-b0bfe7eab7c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:51.875149 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366545c-26ca-4fd6-90e1-b0bfe7eab7c8 service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:51.875628 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366545c-26ca-4fd6-90e1-b0bfe7eab7c8 service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:51.876095 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1366545c-26ca-4fd6-90e1-b0bfe7eab7c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:51.893717 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366545c-26ca-4fd6-90e1-b0bfe7eab7c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:51.896688 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1366545c-26ca-4fd6-90e1-b0bfe7eab7c8 service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:51.914639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 555/1098] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:54.613787 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bc1e3-7c3d-4617-9a0d-9ffbd6536e98 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:54.614386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bc1e3-7c3d-4617-9a0d-9ffbd6536e98 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:54.614386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185bc1e3-7c3d-4617-9a0d-9ffbd6536e98 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:54.615831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 544/1099] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:54.621618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959e4b1-53e3-4cf9-a3a9-bf839c730c2c None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:54.622043 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959e4b1-53e3-4cf9-a3a9-bf839c730c2c None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:54.622205 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a959e4b1-53e3-4cf9-a3a9-bf839c730c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:54.644001 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-a959e4b1-53e3-4cf9-a3a9-bf839c730c2c None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:54.645291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-a959e4b1-53e3-4cf9-a3a9-bf839c730c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:54.654176 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 556/1100] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:54.693555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bc1e3-7c3d-4617-9a0d-9ffbd6536e98 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:54.706974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185bc1e3-7c3d-4617-9a0d-9ffbd6536e98 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:54.710784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83384e2-fd10-40f9-a4e1-ffb96a3bb44d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:54.711447 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83384e2-fd10-40f9-a4e1-ffb96a3bb44d service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:54.711746 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83384e2-fd10-40f9-a4e1-ffb96a3bb44d service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:54.712000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83384e2-fd10-40f9-a4e1-ffb96a3bb44d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:54.724853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83384e2-fd10-40f9-a4e1-ffb96a3bb44d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:54.726358 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83384e2-fd10-40f9-a4e1-ffb96a3bb44d service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:54.738528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 545/1101] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:57.181888 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46544a60-5824-4a7b-92df-f2c5272c165c None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:57.182497 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46544a60-5824-4a7b-92df-f2c5272c165c None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:57.182497 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46544a60-5824-4a7b-92df-f2c5272c165c None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:57.183835 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 557/1102] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:57.189981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17d22-a0ee-4355-b272-c28826e460c5 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:57.190528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17d22-a0ee-4355-b272-c28826e460c5 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:57.190528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc17d22-a0ee-4355-b272-c28826e460c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:57.209713 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-4dc17d22-a0ee-4355-b272-c28826e460c5 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:57.210954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-4dc17d22-a0ee-4355-b272-c28826e460c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:57.219508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 546/1103] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:42:57.259479 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46544a60-5824-4a7b-92df-f2c5272c165c None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:42:57.270998 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46544a60-5824-4a7b-92df-f2c5272c165c None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:42:57.274696 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf224759-9828-48d5-a1d2-234598c15b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:42:57.275361 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf224759-9828-48d5-a1d2-234598c15b55 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:57.275694 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf224759-9828-48d5-a1d2-234598c15b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:57.275939 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf224759-9828-48d5-a1d2-234598c15b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:57.286951 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf224759-9828-48d5-a1d2-234598c15b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:42:57.288412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf224759-9828-48d5-a1d2-234598c15b55 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:42:57.298565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 558/1104] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:42:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:42:59.931628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c59561-fc54-443d-ab02-2e9bbbc6776c None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:59.932186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c59561-fc54-443d-ab02-2e9bbbc6776c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:59.932186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c59561-fc54-443d-ab02-2e9bbbc6776c None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:59.933590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 547/1105] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:42:59.940159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc758f2-fc0e-4f18-8058-6578e43dee07 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:42:59.940987 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc758f2-fc0e-4f18-8058-6578e43dee07 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:42:59.941140 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc758f2-fc0e-4f18-8058-6578e43dee07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:42:59.960386 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-6dc758f2-fc0e-4f18-8058-6578e43dee07 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:42:59.961648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-6dc758f2-fc0e-4f18-8058-6578e43dee07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:42:59.970665 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 559/1106] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:42:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:00.013259 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c59561-fc54-443d-ab02-2e9bbbc6776c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:00.025033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c59561-fc54-443d-ab02-2e9bbbc6776c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:00.028761 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550671b8-6c1d-4f50-9989-4a4a21f5a1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:00.029418 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550671b8-6c1d-4f50-9989-4a4a21f5a1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:00.029704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550671b8-6c1d-4f50-9989-4a4a21f5a1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:00.029980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550671b8-6c1d-4f50-9989-4a4a21f5a1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:00.040334 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550671b8-6c1d-4f50-9989-4a4a21f5a1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:00.041832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550671b8-6c1d-4f50-9989-4a4a21f5a1f2 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:00.052501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 548/1107] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:43:02.720244 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dcf4-b13a-4f5d-9fab-0c162f62823e None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:02.720955 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dcf4-b13a-4f5d-9fab-0c162f62823e None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:02.720955 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8dcf4-b13a-4f5d-9fab-0c162f62823e None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:02.722493 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 560/1108] 10.222.0.24 () {54 vars in 926 bytes} [Sat Jun 4 20:43:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:43:02.728908 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53afb8-5390-40b7-9cfb-4e1e9e006e9a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:02.729626 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53afb8-5390-40b7-9cfb-4e1e9e006e9a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:02.729626 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53afb8-5390-40b7-9cfb-4e1e9e006e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:02.750012 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-da53afb8-5390-40b7-9cfb-4e1e9e006e9a None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:43:02.751490 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-da53afb8-5390-40b7-9cfb-4e1e9e006e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:43:02.761051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 549/1109] 10.222.0.24 () {58 vars in 1023 bytes} [Sat Jun 4 20:43:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:43:02.801806 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8dcf4-b13a-4f5d-9fab-0c162f62823e None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:43:02.813481 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8dcf4-b13a-4f5d-9fab-0c162f62823e None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:43:02.817706 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507c4a7-52b2-4abd-8252-d327f802cfd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:43:02.818411 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507c4a7-52b2-4abd-8252-d327f802cfd1 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:43:02.818735 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507c4a7-52b2-4abd-8252-d327f802cfd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:43:02.819047 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507c4a7-52b2-4abd-8252-d327f802cfd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:43:02.830510 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507c4a7-52b2-4abd-8252-d327f802cfd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:43:02.831947 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8507c4a7-52b2-4abd-8252-d327f802cfd1 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:43:02.842347 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 561/1110] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:43:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:43:12.743534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=33 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:43:12.837819 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=33 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:39.428729 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe99767-4f1d-46cd-ac51-016886759bc9 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:39.429377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe99767-4f1d-46cd-ac51-016886759bc9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:39.429377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe99767-4f1d-46cd-ac51-016886759bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:39.496752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-2fe99767-4f1d-46cd-ac51-016886759bc9 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:39.497970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-2fe99767-4f1d-46cd-ac51-016886759bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:39.546285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 550/1111] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:44:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:39.554610 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6b1ca-4ec0-47f3-b648-69c1dd161b51 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:39.555174 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6b1ca-4ec0-47f3-b648-69c1dd161b51 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:39.555174 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c6b1ca-4ec0-47f3-b648-69c1dd161b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:39.574646 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-17c6b1ca-4ec0-47f3-b648-69c1dd161b51 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:39.575860 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-17c6b1ca-4ec0-47f3-b648-69c1dd161b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:39.585141 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 562/1112] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:44:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:39.590199 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe99767-4f1d-46cd-ac51-016886759bc9 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:39.600315 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe99767-4f1d-46cd-ac51-016886759bc9 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:39.605131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1311c-34ac-4aa7-b62b-5612b32046ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:39.605902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1311c-34ac-4aa7-b62b-5612b32046ea admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:39.606188 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1311c-34ac-4aa7-b62b-5612b32046ea admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:39.606471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1311c-34ac-4aa7-b62b-5612b32046ea admin admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:39.607209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1311c-34ac-4aa7-b62b-5612b32046ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:44:39.607521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1311c-34ac-4aa7-b62b-5612b32046ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:39.608588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-28e1311c-34ac-4aa7-b62b-5612b32046ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:44:39.608588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jun 04 20:44:39.608588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jun 04 20:44:39.609500 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1311c-34ac-4aa7-b62b-5612b32046ea admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:39.622470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 551/1113] 10.222.0.24 () {58 vars in 1152 bytes} [Sat Jun 4 20:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:44:39.631904 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6b1ca-4ec0-47f3-b648-69c1dd161b51 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:39.641942 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c6b1ca-4ec0-47f3-b648-69c1dd161b51 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:39.647864 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111e2fa-1b03-4e68-9c21-e45e34e6a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:39.648559 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111e2fa-1b03-4e68-9c21-e45e34e6a9ba admin admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:39.648878 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111e2fa-1b03-4e68-9c21-e45e34e6a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:39.649105 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111e2fa-1b03-4e68-9c21-e45e34e6a9ba admin admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:39.649838 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111e2fa-1b03-4e68-9c21-e45e34e6a9ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:39.651729 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: WARNING py.warnings [None req-e111e2fa-1b03-4e68-9c21-e45e34e6a9ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:44:39.651729 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: warnings.warn(msg) Jun 04 20:44:39.651729 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: Jun 04 20:44:39.653010 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111e2fa-1b03-4e68-9c21-e45e34e6a9ba admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:39.691887 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 563/1114] 10.222.0.24 () {60 vars in 1152 bytes} [Sat Jun 4 20:44:39 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:44:39.696469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1311c-34ac-4aa7-b62b-5612b32046ea admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:39.708412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1311c-34ac-4aa7-b62b-5612b32046ea admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:39.768658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c7a17-253e-436c-a669-7f40b19b7dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:39.769253 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c7a17-253e-436c-a669-7f40b19b7dab admin admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:39.769537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c7a17-253e-436c-a669-7f40b19b7dab admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:39.769819 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c7a17-253e-436c-a669-7f40b19b7dab admin admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:39.770520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c7a17-253e-436c-a669-7f40b19b7dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:39.771560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-9e9c7a17-253e-436c-a669-7f40b19b7dab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:44:39.771560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jun 04 20:44:39.771560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jun 04 20:44:39.772821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c7a17-253e-436c-a669-7f40b19b7dab admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:39.793169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 552/1115] 10.222.0.24 () {60 vars in 1143 bytes} [Sat Jun 4 20:44:39 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:44:39.797491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111e2fa-1b03-4e68-9c21-e45e34e6a9ba admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:39.808794 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111e2fa-1b03-4e68-9c21-e45e34e6a9ba admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:39.814207 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be2745-aff7-47eb-9a48-1e894e69f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:39.814908 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be2745-aff7-47eb-9a48-1e894e69f7dd admin admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:39.815176 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be2745-aff7-47eb-9a48-1e894e69f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:39.815451 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be2745-aff7-47eb-9a48-1e894e69f7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:39.816186 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be2745-aff7-47eb-9a48-1e894e69f7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:39.817250 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: WARNING py.warnings [None req-b9be2745-aff7-47eb-9a48-1e894e69f7dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:44:39.817250 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: warnings.warn(msg) Jun 04 20:44:39.817250 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: Jun 04 20:44:39.818145 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be2745-aff7-47eb-9a48-1e894e69f7dd admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:39.832621 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 564/1116] 10.222.0.24 () {58 vars in 1121 bytes} [Sat Jun 4 20:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:44:39.836993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c7a17-253e-436c-a669-7f40b19b7dab admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:39.848212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c7a17-253e-436c-a669-7f40b19b7dab admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:39.854207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78316f32-97ad-41c6-9381-e85fbe0e4098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:39.854880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78316f32-97ad-41c6-9381-e85fbe0e4098 admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:39.855172 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78316f32-97ad-41c6-9381-e85fbe0e4098 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:39.855459 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78316f32-97ad-41c6-9381-e85fbe0e4098 admin admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:39.856240 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78316f32-97ad-41c6-9381-e85fbe0e4098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:39.857314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-78316f32-97ad-41c6-9381-e85fbe0e4098 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:44:39.857314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jun 04 20:44:39.857314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jun 04 20:44:39.858309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78316f32-97ad-41c6-9381-e85fbe0e4098 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:39.873181 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 553/1117] 10.222.0.24 () {58 vars in 1121 bytes} [Sat Jun 4 20:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:44:39.878177 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be2745-aff7-47eb-9a48-1e894e69f7dd admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:39.889487 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be2745-aff7-47eb-9a48-1e894e69f7dd admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:39.894483 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf4550-bbb4-4cc9-98a0-de1597265c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:39.895379 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf4550-bbb4-4cc9-98a0-de1597265c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:39.895668 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf4550-bbb4-4cc9-98a0-de1597265c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:39.895946 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf4550-bbb4-4cc9-98a0-de1597265c0c admin admin] PATH_INFO: `/v3/projects/e3453b8a854843a9a5c6472f38e26c72/users/b2146e9a09304619a88f3f82982f4003/roles/52b41e61eb19402aa67a7defc45d7f5f` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:39.911746 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf4550-bbb4-4cc9-98a0-de1597265c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3453b8a854843a9a5c6472f38e26c72, user_id=b2146e9a09304619a88f3f82982f4003, role_id=52b41e61eb19402aa67a7defc45d7f5f)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:39.912832 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: WARNING py.warnings [None req-5baf4550-bbb4-4cc9-98a0-de1597265c0c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:44:39.912832 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: warnings.warn(msg) Jun 04 20:44:39.912832 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: Jun 04 20:44:39.914757 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf4550-bbb4-4cc9-98a0-de1597265c0c admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:39.930266 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 565/1118] 10.222.0.24 () {60 vars in 1482 bytes} [Sat Jun 4 20:44:39 2022] PUT /identity/v3/projects/e3453b8a854843a9a5c6472f38e26c72/users/b2146e9a09304619a88f3f82982f4003/roles/52b41e61eb19402aa67a7defc45d7f5f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:44:39.943375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5294aa-1b5e-440d-9f49-f02487fed69a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:39.943635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5294aa-1b5e-440d-9f49-f02487fed69a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:39.943930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5294aa-1b5e-440d-9f49-f02487fed69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:39.971369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-ec5294aa-1b5e-440d-9f49-f02487fed69a None None] MFA Rules not processed for user `b2146e9a09304619a88f3f82982f4003`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:39.972665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ec5294aa-1b5e-440d-9f49-f02487fed69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:40.009847 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:40.044136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 554/1119] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:44:39 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:44:40.057861 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed310f1a-4d29-4663-86ef-4204289a10b6 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:40.058152 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed310f1a-4d29-4663-86ef-4204289a10b6 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:40.058582 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed310f1a-4d29-4663-86ef-4204289a10b6 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:40.059971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 566/1120] 10.222.0.24 () {54 vars in 963 bytes} [Sat Jun 4 20:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:40.065229 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8dd63-cf00-447a-b0e1-a0a35f66c5e5 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:40.065523 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8dd63-cf00-447a-b0e1-a0a35f66c5e5 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:40.065808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be8dd63-cf00-447a-b0e1-a0a35f66c5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:40.095645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-4be8dd63-cf00-447a-b0e1-a0a35f66c5e5 None None] MFA Rules not processed for user `eea7c50b99044720801876cce86e4311`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:40.096902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-4be8dd63-cf00-447a-b0e1-a0a35f66c5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:40.171773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 555/1121] 10.222.0.24 () {58 vars in 1060 bytes} [Sat Jun 4 20:44:40 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:44:40.179753 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed310f1a-4d29-4663-86ef-4204289a10b6 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:40.192466 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed310f1a-4d29-4663-86ef-4204289a10b6 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:40.196344 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a595f48-9da4-42a0-86ad-df2677a24cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea7c50b99044720801876cce86e4311', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:40.197098 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a595f48-9da4-42a0-86ad-df2677a24cab service cinder] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:40.197384 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a595f48-9da4-42a0-86ad-df2677a24cab service cinder] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:40.197668 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a595f48-9da4-42a0-86ad-df2677a24cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:40.206889 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a595f48-9da4-42a0-86ad-df2677a24cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:40.208336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a595f48-9da4-42a0-86ad-df2677a24cab service cinder] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:40.217787 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 567/1122] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:40 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:44:40.254237 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bcbb0-9fb6-4622-8408-b0fb7fb4c9fd None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:40.254529 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bcbb0-9fb6-4622-8408-b0fb7fb4c9fd None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:40.254833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633bcbb0-9fb6-4622-8408-b0fb7fb4c9fd None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:40.256140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 556/1123] 10.222.0.24 () {52 vars in 829 bytes} [Sat Jun 4 20:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:44:40.259965 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a595f48-9da4-42a0-86ad-df2677a24cab service cinder] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:40.327312 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a595f48-9da4-42a0-86ad-df2677a24cab service cinder] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:40.332558 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:40.333428 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:40.333738 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:40.334061 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] PATH_INFO: `/v3/users/b2146e9a09304619a88f3f82982f4003` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:40.335331 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2146e9a09304619a88f3f82982f4003)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:40.336367 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: WARNING py.warnings [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:44:40.336367 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: warnings.warn(msg) Jun 04 20:44:40.336367 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: Jun 04 20:44:40.337620 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:40.409734 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2146e9a09304619a88f3f82982f4003'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:44:40.410481 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2146e9a09304619a88f3f82982f4003'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:44:40.423766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2146e9a09304619a88f3f82982f4003'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:44:40.424650 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2146e9a09304619a88f3f82982f4003'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:44:40.436053 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2146e9a09304619a88f3f82982f4003'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:44:40.456247 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:40.467945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 568/1124] 10.222.0.24 () {58 vars in 1223 bytes} [Sat Jun 4 20:44:40 2022] DELETE /identity/v3/users/b2146e9a09304619a88f3f82982f4003 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:44:40.472718 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a5314-9ba0-4ebc-8b74-40c8430b383d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:40.473363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a5314-9ba0-4ebc-8b74-40c8430b383d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:40.473363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a5314-9ba0-4ebc-8b74-40c8430b383d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:40.492096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-cb7a5314-9ba0-4ebc-8b74-40c8430b383d None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:44:40.493376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-cb7a5314-9ba0-4ebc-8b74-40c8430b383d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:40.559571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 557/1125] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:44:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:44:40.571143 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:40.573023 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:40.644750 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4544a632-1300-42c0-809a-e4470a723d4d admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:40.648811 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed6f85-f36e-4a3e-9439-c3f7e9c42217 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:40.649589 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed6f85-f36e-4a3e-9439-c3f7e9c42217 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:40.649954 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed6f85-f36e-4a3e-9439-c3f7e9c42217 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:40.650267 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed6f85-f36e-4a3e-9439-c3f7e9c42217 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:40.661055 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed6f85-f36e-4a3e-9439-c3f7e9c42217 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:40.662511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed6f85-f36e-4a3e-9439-c3f7e9c42217 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:40.672472 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 569/1126] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:44:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:44:41.015782 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a5314-9ba0-4ebc-8b74-40c8430b383d None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:44:41.017180 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-cb7a5314-9ba0-4ebc-8b74-40c8430b383d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:44:41.038565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a5314-9ba0-4ebc-8b74-40c8430b383d None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:44:41.046702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:44:41.048112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:44:41.048592 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:44:41.048980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] PATH_INFO: `/v3/projects/e3453b8a854843a9a5c6472f38e26c72` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:44:41.050283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3453b8a854843a9a5c6472f38e26c72)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:44:41.051443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:44:41.051443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jun 04 20:44:41.051443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jun 04 20:44:41.052846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:44:41.128348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3453b8a854843a9a5c6472f38e26c72', 'request_id': 'req-de32c4b3-8328-4f0f-892f-fe53d315e27d'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:44:41.132778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:41.135359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3453b8a854843a9a5c6472f38e26c72', 'request_id': 'req-de32c4b3-8328-4f0f-892f-fe53d315e27d'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:44:41.149519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3453b8a854843a9a5c6472f38e26c72', 'request_id': 'req-de32c4b3-8328-4f0f-892f-fe53d315e27d'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:44:41.167493 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] The token cache is being invalidate because project e3453b8a854843a9a5c6472f38e26c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98933) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:44:41.167725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:44:41.169052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-de32c4b3-8328-4f0f-892f-fe53d315e27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:44:41.171093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 558/1127] 10.222.0.24 () {58 vars in 1232 bytes} [Sat Jun 4 20:44:41 2022] DELETE /identity/v3/projects/e3453b8a854843a9a5c6472f38e26c72 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:44:50.667847 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:44:51.164390 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:DELETE=2,keystone:SELECT=5,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:45:59.070611 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b25a-4768-44ff-8337-701198ac7637 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:59.071253 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b25a-4768-44ff-8337-701198ac7637 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:59.071253 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87b25a-4768-44ff-8337-701198ac7637 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:59.072723 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 570/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:45:59.077958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416ae0d-dbfe-4b0e-b0ad-663ae0cf4d2a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:59.078448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416ae0d-dbfe-4b0e-b0ad-663ae0cf4d2a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:59.078551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5416ae0d-dbfe-4b0e-b0ad-663ae0cf4d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:59.097829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-5416ae0d-dbfe-4b0e-b0ad-663ae0cf4d2a None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:45:59.099053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-5416ae0d-dbfe-4b0e-b0ad-663ae0cf4d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:45:59.171620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 559/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:45:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:45:59.345490 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87b25a-4768-44ff-8337-701198ac7637 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:45:59.347503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-7f87b25a-4768-44ff-8337-701198ac7637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:45:59.424128 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87b25a-4768-44ff-8337-701198ac7637 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:45:59.429848 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfcba19-3c1f-4c99-946e-5d7a07fcf55f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:45:59.430509 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcba19-3c1f-4c99-946e-5d7a07fcf55f service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:45:59.430834 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcba19-3c1f-4c99-946e-5d7a07fcf55f service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:45:59.431167 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfcba19-3c1f-4c99-946e-5d7a07fcf55f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:45:59.441038 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcba19-3c1f-4c99-946e-5d7a07fcf55f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:45:59.443266 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfcba19-3c1f-4c99-946e-5d7a07fcf55f service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:45:59.454574 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 571/1130] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:45:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:46:00.336279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd29e-0481-4e94-b8e9-213581595068 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:00.336928 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd29e-0481-4e94-b8e9-213581595068 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:00.336928 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd29e-0481-4e94-b8e9-213581595068 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:00.338710 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 560/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:46:00.344041 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ffc0c-1fcc-45d1-b6b1-1fb710184caa None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:00.344550 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ffc0c-1fcc-45d1-b6b1-1fb710184caa None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:00.344667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ffc0c-1fcc-45d1-b6b1-1fb710184caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:00.364212 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-6a2ffc0c-1fcc-45d1-b6b1-1fb710184caa None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:00.365460 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-6a2ffc0c-1fcc-45d1-b6b1-1fb710184caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:00.373947 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 572/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:46:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:00.529644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd29e-0481-4e94-b8e9-213581595068 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:00.544671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd29e-0481-4e94-b8e9-213581595068 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:00.550900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6845d99-4feb-4682-bf9b-d4e19a8a2c85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:00.551546 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6845d99-4feb-4682-bf9b-d4e19a8a2c85 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:00.551833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6845d99-4feb-4682-bf9b-d4e19a8a2c85 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:00.552134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6845d99-4feb-4682-bf9b-d4e19a8a2c85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:00.561729 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6845d99-4feb-4682-bf9b-d4e19a8a2c85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:00.563346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6845d99-4feb-4682-bf9b-d4e19a8a2c85 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:00.573730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 561/1133] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:46:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:46:04.859409 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6f7e-fa53-473c-8030-ba9effdc1db7 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:04.860035 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6f7e-fa53-473c-8030-ba9effdc1db7 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:04.860035 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557d6f7e-fa53-473c-8030-ba9effdc1db7 None None] PATH_INFO: `/v3` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:04.861349 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 573/1134] 10.222.0.45 () {54 vars in 925 bytes} [Sat Jun 4 20:46:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 04 20:46:04.867964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03433197-cfcc-4a20-b9a4-2dc28b942e1e None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:04.868917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03433197-cfcc-4a20-b9a4-2dc28b942e1e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:04.868917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03433197-cfcc-4a20-b9a4-2dc28b942e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:04.889128 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-03433197-cfcc-4a20-b9a4-2dc28b942e1e None None] MFA Rules not processed for user `22f68848269a453289f64d57415fcee5`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:04.890349 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-03433197-cfcc-4a20-b9a4-2dc28b942e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:04.954807 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 562/1135] 10.222.0.45 () {58 vars in 1015 bytes} [Sat Jun 4 20:46:04 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:10.358712 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=35 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:46:11.910253 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db611fb-0aa2-4bb9-8e54-5adb34aafed5 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:11.910905 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db611fb-0aa2-4bb9-8e54-5adb34aafed5 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:11.910905 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db611fb-0aa2-4bb9-8e54-5adb34aafed5 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:11.912139 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 574/1136] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:46:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:46:11.918267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7534385-6960-477f-96b2-bccdf1913069 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:11.918779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7534385-6960-477f-96b2-bccdf1913069 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:11.918779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7534385-6960-477f-96b2-bccdf1913069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:11.941145 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e7534385-6960-477f-96b2-bccdf1913069 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:11.942645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e7534385-6960-477f-96b2-bccdf1913069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:11.952320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 563/1137] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:46:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:12.108508 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db611fb-0aa2-4bb9-8e54-5adb34aafed5 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:12.124383 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db611fb-0aa2-4bb9-8e54-5adb34aafed5 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:12.130050 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1369a266-be9d-4626-a7cb-aa41552f2baa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:12.130700 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a266-be9d-4626-a7cb-aa41552f2baa service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:12.130984 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a266-be9d-4626-a7cb-aa41552f2baa service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:12.131261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1369a266-be9d-4626-a7cb-aa41552f2baa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:12.140177 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369a266-be9d-4626-a7cb-aa41552f2baa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:12.141815 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1369a266-be9d-4626-a7cb-aa41552f2baa service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:12.152464 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 575/1138] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:46:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:46:13.056756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009d377-86e9-4783-bc13-97c4b98acfcf None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:13.057399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009d377-86e9-4783-bc13-97c4b98acfcf None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:13.057399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009d377-86e9-4783-bc13-97c4b98acfcf None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:13.058701 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 564/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jun 4 20:46:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:46:13.064293 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ca6fe-05d9-46f8-9f51-436d7be8a69f None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:13.064788 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ca6fe-05d9-46f8-9f51-436d7be8a69f None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:13.064902 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ca6fe-05d9-46f8-9f51-436d7be8a69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:13.083923 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-974ca6fe-05d9-46f8-9f51-436d7be8a69f None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:13.085185 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-974ca6fe-05d9-46f8-9f51-436d7be8a69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:13.093990 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 576/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jun 4 20:46:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:13.257272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009d377-86e9-4783-bc13-97c4b98acfcf None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:13.272330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009d377-86e9-4783-bc13-97c4b98acfcf None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:13.277979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a4c47-5ef6-4863-9e6a-ae4ae639304d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:13.278653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a4c47-5ef6-4863-9e6a-ae4ae639304d service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:13.278939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a4c47-5ef6-4863-9e6a-ae4ae639304d service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:13.279214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a4c47-5ef6-4863-9e6a-ae4ae639304d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:13.289536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a4c47-5ef6-4863-9e6a-ae4ae639304d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:13.291389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a4c47-5ef6-4863-9e6a-ae4ae639304d service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:13.301702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 565/1141] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:46:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:46:13.808685 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208120e-d8e5-4b54-9574-fe3595878819 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:13.809148 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208120e-d8e5-4b54-9574-fe3595878819 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:13.809468 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208120e-d8e5-4b54-9574-fe3595878819 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:13.811662 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 577/1142] 10.222.0.24 () {54 vars in 960 bytes} [Sat Jun 4 20:46:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:46:13.819910 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af737c1e-cd25-48d3-a8eb-b06e87f3eb82 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:13.820185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af737c1e-cd25-48d3-a8eb-b06e87f3eb82 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:13.820507 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af737c1e-cd25-48d3-a8eb-b06e87f3eb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:13.839796 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-af737c1e-cd25-48d3-a8eb-b06e87f3eb82 None None] MFA Rules not processed for user `22f68848269a453289f64d57415fcee5`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:13.841031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-af737c1e-cd25-48d3-a8eb-b06e87f3eb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:13.850280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 566/1143] 10.222.0.24 () {58 vars in 1057 bytes} [Sat Jun 4 20:46:13 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:46:13.858166 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208120e-d8e5-4b54-9574-fe3595878819 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:13.873825 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208120e-d8e5-4b54-9574-fe3595878819 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:13.879108 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a02ec-f4a3-4a41-88d8-a77a73f39db2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f68848269a453289f64d57415fcee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:13.879747 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a02ec-f4a3-4a41-88d8-a77a73f39db2 service placement] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:13.880035 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a02ec-f4a3-4a41-88d8-a77a73f39db2 service placement] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:13.880305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a02ec-f4a3-4a41-88d8-a77a73f39db2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:13.889617 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a02ec-f4a3-4a41-88d8-a77a73f39db2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:13.891229 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a02ec-f4a3-4a41-88d8-a77a73f39db2 service placement] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:13.901771 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 578/1144] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:46:13 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:46:17.391681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bb6e5-eb11-4a16-a731-60709cc0d76c None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:17.392283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bb6e5-eb11-4a16-a731-60709cc0d76c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:17.392283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098bb6e5-eb11-4a16-a731-60709cc0d76c None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:17.393616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 567/1145] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:46:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:46:17.399549 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a229c9d-1c9d-46ee-90e7-160026cbb105 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:17.400157 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a229c9d-1c9d-46ee-90e7-160026cbb105 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:17.400157 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a229c9d-1c9d-46ee-90e7-160026cbb105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:17.419217 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-0a229c9d-1c9d-46ee-90e7-160026cbb105 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:17.420459 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-0a229c9d-1c9d-46ee-90e7-160026cbb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:17.428847 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 579/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:46:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:17.466066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bb6e5-eb11-4a16-a731-60709cc0d76c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:17.468640 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-098bb6e5-eb11-4a16-a731-60709cc0d76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:17.545043 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:46:17.551348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098bb6e5-eb11-4a16-a731-60709cc0d76c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:17.555109 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6720a-6e2e-4ff5-a483-302fa502cc24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:17.555816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6720a-6e2e-4ff5-a483-302fa502cc24 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:17.556126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6720a-6e2e-4ff5-a483-302fa502cc24 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:17.556407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6720a-6e2e-4ff5-a483-302fa502cc24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:17.566029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6720a-6e2e-4ff5-a483-302fa502cc24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:17.567494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6720a-6e2e-4ff5-a483-302fa502cc24 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:17.578271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 568/1147] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:46:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:46:19.891153 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a15c2-23e7-4c0a-a078-7c1a56fccd0b None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:19.891713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a15c2-23e7-4c0a-a078-7c1a56fccd0b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:19.891713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a15c2-23e7-4c0a-a078-7c1a56fccd0b None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:19.893061 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 580/1148] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 04 20:46:19.898688 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d7fe-3431-4186-8d30-6d366b13e00f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:19.899246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d7fe-3431-4186-8d30-6d366b13e00f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:19.899364 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531d7fe-3431-4186-8d30-6d366b13e00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:19.919005 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-4531d7fe-3431-4186-8d30-6d366b13e00f None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:19.920227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-4531d7fe-3431-4186-8d30-6d366b13e00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:19.929245 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 569/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:46:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:19.975463 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a15c2-23e7-4c0a-a078-7c1a56fccd0b None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:19.988261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a15c2-23e7-4c0a-a078-7c1a56fccd0b None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:19.992249 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277da76-c5cb-4e60-bb9f-3c3f29659a18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:19.993076 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277da76-c5cb-4e60-bb9f-3c3f29659a18 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:19.993440 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277da76-c5cb-4e60-bb9f-3c3f29659a18 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:19.993606 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277da76-c5cb-4e60-bb9f-3c3f29659a18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:20.003857 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277da76-c5cb-4e60-bb9f-3c3f29659a18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:20.005353 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277da76-c5cb-4e60-bb9f-3c3f29659a18 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:20.015985 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 581/1150] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:46:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:46:23.902903 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d03e02-a841-4943-81e6-505152113453 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:23.906934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d03e02-a841-4943-81e6-505152113453 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:23.906934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d03e02-a841-4943-81e6-505152113453 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:23.906934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 570/1151] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:46:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:46:23.911199 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c469-5e6d-49fa-b50c-dfe30226d6d7 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:23.911725 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c469-5e6d-49fa-b50c-dfe30226d6d7 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:23.911725 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7c469-5e6d-49fa-b50c-dfe30226d6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:23.932309 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-3dc7c469-5e6d-49fa-b50c-dfe30226d6d7 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:23.933652 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-3dc7c469-5e6d-49fa-b50c-dfe30226d6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:23.942058 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 582/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:46:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:24.219023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d03e02-a841-4943-81e6-505152113453 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:24.221007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-15d03e02-a841-4943-81e6-505152113453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:24.302116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d03e02-a841-4943-81e6-505152113453 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:24.306095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd242e-152d-4a4c-b9c9-15302dbf1283 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea7c50b99044720801876cce86e4311', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:24.306924 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd242e-152d-4a4c-b9c9-15302dbf1283 service cinder] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:24.307306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd242e-152d-4a4c-b9c9-15302dbf1283 service cinder] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:24.307695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd242e-152d-4a4c-b9c9-15302dbf1283 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:24.319080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd242e-152d-4a4c-b9c9-15302dbf1283 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:24.321370 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd242e-152d-4a4c-b9c9-15302dbf1283 service cinder] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:24.332067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 571/1153] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:46:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:46:26.788565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b15a-36f6-465e-b712-46969afa6e18 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:26.789291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b15a-36f6-465e-b712-46969afa6e18 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:26.789291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648b15a-36f6-465e-b712-46969afa6e18 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:26.791667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 583/1154] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jun 4 20:46:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:46:26.797645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a31a2-2b6d-4143-ad90-6c73ddc0cd9f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:26.798199 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a31a2-2b6d-4143-ad90-6c73ddc0cd9f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:26.798199 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a31a2-2b6d-4143-ad90-6c73ddc0cd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:26.818211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-6a6a31a2-2b6d-4143-ad90-6c73ddc0cd9f None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:46:26.819456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-6a6a31a2-2b6d-4143-ad90-6c73ddc0cd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:26.827797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 572/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jun 4 20:46:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:46:27.103406 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b15a-36f6-465e-b712-46969afa6e18 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:46:27.105475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-3648b15a-36f6-465e-b712-46969afa6e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:46:27.121997 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648b15a-36f6-465e-b712-46969afa6e18 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:46:27.126529 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc78292a-6dc3-4ac4-a426-f80f16b590f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eea7c50b99044720801876cce86e4311', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:46:27.127189 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78292a-6dc3-4ac4-a426-f80f16b590f4 service cinder] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:46:27.127553 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78292a-6dc3-4ac4-a426-f80f16b590f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:46:27.127753 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc78292a-6dc3-4ac4-a426-f80f16b590f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:46:27.137845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78292a-6dc3-4ac4-a426-f80f16b590f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:46:27.139305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc78292a-6dc3-4ac4-a426-f80f16b590f4 service cinder] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:46:27.149074 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 584/1156] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:46:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:46:36.812960 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=42 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:46:37.144870 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=33 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:46.927790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156701-5b71-4279-9675-87553541fb9a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:46.930147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156701-5b71-4279-9675-87553541fb9a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:46.930147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94156701-5b71-4279-9675-87553541fb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:46.948246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-94156701-5b71-4279-9675-87553541fb9a None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:47:46.949277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-94156701-5b71-4279-9675-87553541fb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:47:46.958815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 573/1157] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:47:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:47:46.967420 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107179e-0498-48b3-8596-66262db94a88 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:46.968237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107179e-0498-48b3-8596-66262db94a88 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:46.968237 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107179e-0498-48b3-8596-66262db94a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:46.982950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bc956-5395-48a3-97f0-83e3bdd18aa0 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:46.983242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bc956-5395-48a3-97f0-83e3bdd18aa0 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:46.983559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bc956-5395-48a3-97f0-83e3bdd18aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:46.989348 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-b107179e-0498-48b3-8596-66262db94a88 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:47:46.990990 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-b107179e-0498-48b3-8596-66262db94a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:47:46.999112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 585/1158] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:47:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:47:47.003764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f62bc956-5395-48a3-97f0-83e3bdd18aa0 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:47:47.004188 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107179e-0498-48b3-8596-66262db94a88 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.005255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f62bc956-5395-48a3-97f0-83e3bdd18aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:47:47.013465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 574/1159] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:47:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:47:47.014476 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107179e-0498-48b3-8596-66262db94a88 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.018636 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b43cc-c466-44a0-abd3-3d41e335c12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.019300 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b43cc-c466-44a0-abd3-3d41e335c12e admin admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.019590 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b43cc-c466-44a0-abd3-3d41e335c12e admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.019846 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b43cc-c466-44a0-abd3-3d41e335c12e admin admin] PATH_INFO: `/v3/domains` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.020627 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b43cc-c466-44a0-abd3-3d41e335c12e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98932) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:47:47.020905 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b43cc-c466-44a0-abd3-3d41e335c12e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.021988 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a39d-8fcd-4c37-9cf6-a9a31e187275 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.022491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: WARNING py.warnings [None req-297b43cc-c466-44a0-abd3-3d41e335c12e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:47:47.022491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: warnings.warn(msg) Jun 04 20:47:47.022491 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: Jun 04 20:47:47.022776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a39d-8fcd-4c37-9cf6-a9a31e187275 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.022776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9a39d-8fcd-4c37-9cf6-a9a31e187275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.023024 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b43cc-c466-44a0-abd3-3d41e335c12e admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.035643 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 586/1160] 10.222.0.24 () {58 vars in 1152 bytes} [Sat Jun 4 20:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:47:47.040722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a7d9a39d-8fcd-4c37-9cf6-a9a31e187275 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:47:47.041912 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a7d9a39d-8fcd-4c37-9cf6-a9a31e187275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:47:47.043745 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b43cc-c466-44a0-abd3-3d41e335c12e admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.050917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 575/1161] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:47:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:47:47.054160 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b43cc-c466-44a0-abd3-3d41e335c12e admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.056018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9a39d-8fcd-4c37-9cf6-a9a31e187275 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.058888 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1551963-95c5-42dd-b2dd-8d545ef7b12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.059541 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1551963-95c5-42dd-b2dd-8d545ef7b12f admin admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.059827 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1551963-95c5-42dd-b2dd-8d545ef7b12f admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.060110 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1551963-95c5-42dd-b2dd-8d545ef7b12f admin admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.060841 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1551963-95c5-42dd-b2dd-8d545ef7b12f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.062761 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1551963-95c5-42dd-b2dd-8d545ef7b12f admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.065444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9a39d-8fcd-4c37-9cf6-a9a31e187275 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.070817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1297a5-5096-49d8-8a09-34f9128268f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.071477 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1297a5-5096-49d8-8a09-34f9128268f5 admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.071762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1297a5-5096-49d8-8a09-34f9128268f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.072040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1297a5-5096-49d8-8a09-34f9128268f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.072803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1297a5-5096-49d8-8a09-34f9128268f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 04 20:47:47.073168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1297a5-5096-49d8-8a09-34f9128268f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.074832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1297a5-5096-49d8-8a09-34f9128268f5 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.089881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 576/1162] 10.222.0.24 () {58 vars in 1152 bytes} [Sat Jun 4 20:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 04 20:47:47.093048 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 587/1163] 10.222.0.24 () {60 vars in 1152 bytes} [Sat Jun 4 20:47:47 2022] POST /identity/v3/projects => generated 379 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:47:47.097129 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1297a5-5096-49d8-8a09-34f9128268f5 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.098166 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1551963-95c5-42dd-b2dd-8d545ef7b12f admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.109359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1297a5-5096-49d8-8a09-34f9128268f5 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.170245 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1551963-95c5-42dd-b2dd-8d545ef7b12f admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.170694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154c7f-1ae6-4cb1-b141-0fcb1c4683c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.171452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154c7f-1ae6-4cb1-b141-0fcb1c4683c8 admin admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.171867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154c7f-1ae6-4cb1-b141-0fcb1c4683c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.172230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b154c7f-1ae6-4cb1-b141-0fcb1c4683c8 admin admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.172948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b154c7f-1ae6-4cb1-b141-0fcb1c4683c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.175052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b154c7f-1ae6-4cb1-b141-0fcb1c4683c8 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.176689 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82df7f-7d80-4ac3-9d02-3247b0780a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.177380 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82df7f-7d80-4ac3-9d02-3247b0780a97 admin admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.177682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82df7f-7d80-4ac3-9d02-3247b0780a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.178159 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82df7f-7d80-4ac3-9d02-3247b0780a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.178810 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82df7f-7d80-4ac3-9d02-3247b0780a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.180748 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82df7f-7d80-4ac3-9d02-3247b0780a97 admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.202026 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 577/1164] 10.222.0.24 () {60 vars in 1143 bytes} [Sat Jun 4 20:47:47 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:47:47.203225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154c7f-1ae6-4cb1-b141-0fcb1c4683c8 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.211608 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 588/1165] 10.222.0.24 () {60 vars in 1152 bytes} [Sat Jun 4 20:47:47 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:47:47.215862 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82df7f-7d80-4ac3-9d02-3247b0780a97 admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.217978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b154c7f-1ae6-4cb1-b141-0fcb1c4683c8 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.278036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6fa6b-225d-4632-8a0d-98daa86ed510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.278718 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6fa6b-225d-4632-8a0d-98daa86ed510 admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.279002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6fa6b-225d-4632-8a0d-98daa86ed510 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.279280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6fa6b-225d-4632-8a0d-98daa86ed510 admin admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.279908 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82df7f-7d80-4ac3-9d02-3247b0780a97 admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.280025 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6fa6b-225d-4632-8a0d-98daa86ed510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.281694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6fa6b-225d-4632-8a0d-98daa86ed510 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.284504 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240229f-53c0-48b7-8b9b-64cbcaf3b692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.285176 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240229f-53c0-48b7-8b9b-64cbcaf3b692 admin admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.285459 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240229f-53c0-48b7-8b9b-64cbcaf3b692 admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.285734 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f240229f-53c0-48b7-8b9b-64cbcaf3b692 admin admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.286422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240229f-53c0-48b7-8b9b-64cbcaf3b692 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.287672 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: WARNING py.warnings [None req-f240229f-53c0-48b7-8b9b-64cbcaf3b692 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:47:47.287672 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: warnings.warn(msg) Jun 04 20:47:47.287672 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: Jun 04 20:47:47.289232 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f240229f-53c0-48b7-8b9b-64cbcaf3b692 admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.292143 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 578/1166] 10.222.0.24 () {58 vars in 1121 bytes} [Sat Jun 4 20:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:47:47.296132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6fa6b-225d-4632-8a0d-98daa86ed510 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.308234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6fa6b-225d-4632-8a0d-98daa86ed510 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.310485 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 589/1167] 10.222.0.24 () {60 vars in 1143 bytes} [Sat Jun 4 20:47:47 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:47:47.312831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0de2f-d310-451f-91c2-1a9550da4d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.313507 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0de2f-d310-451f-91c2-1a9550da4d4b admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.313790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0de2f-d310-451f-91c2-1a9550da4d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.314070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0de2f-d310-451f-91c2-1a9550da4d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.314803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0de2f-d310-451f-91c2-1a9550da4d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.314927 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240229f-53c0-48b7-8b9b-64cbcaf3b692 admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.316467 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0de2f-d310-451f-91c2-1a9550da4d4b admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.324858 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f240229f-53c0-48b7-8b9b-64cbcaf3b692 admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.328346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 579/1168] 10.222.0.24 () {58 vars in 1121 bytes} [Sat Jun 4 20:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:47:47.329579 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd7dd3-59fa-4ed6-bcca-21d6972057cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.330249 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd7dd3-59fa-4ed6-bcca-21d6972057cb admin admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.330529 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd7dd3-59fa-4ed6-bcca-21d6972057cb admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.330802 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fd7dd3-59fa-4ed6-bcca-21d6972057cb admin admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.331618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd7dd3-59fa-4ed6-bcca-21d6972057cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.332477 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0de2f-d310-451f-91c2-1a9550da4d4b admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.333277 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fd7dd3-59fa-4ed6-bcca-21d6972057cb admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.343108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0de2f-d310-451f-91c2-1a9550da4d4b admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.344412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 590/1169] 10.222.0.24 () {58 vars in 1121 bytes} [Sat Jun 4 20:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:47:47.348091 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff9a10-da4a-405b-8ae6-58f27c99c33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.348251 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd7dd3-59fa-4ed6-bcca-21d6972057cb admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.349041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff9a10-da4a-405b-8ae6-58f27c99c33e admin admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.349303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff9a10-da4a-405b-8ae6-58f27c99c33e admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.349604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff9a10-da4a-405b-8ae6-58f27c99c33e admin admin] PATH_INFO: `/v3/projects/ce190dcb329c4cc7b5a0dc4ebe5bfabd/users/eef267c708bf41eda4e2b3aaa7a0f0e4/roles/52b41e61eb19402aa67a7defc45d7f5f` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.358727 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fd7dd3-59fa-4ed6-bcca-21d6972057cb admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.363710 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cd3dc-c9fa-4dfb-98fb-cd90847fedb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.364386 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd3dc-c9fa-4dfb-98fb-cd90847fedb0 admin admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.364689 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd3dc-c9fa-4dfb-98fb-cd90847fedb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.364967 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9cd3dc-c9fa-4dfb-98fb-cd90847fedb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.365936 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9cd3dc-c9fa-4dfb-98fb-cd90847fedb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.366937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff9a10-da4a-405b-8ae6-58f27c99c33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce190dcb329c4cc7b5a0dc4ebe5bfabd, user_id=eef267c708bf41eda4e2b3aaa7a0f0e4, role_id=52b41e61eb19402aa67a7defc45d7f5f)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.367534 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9cd3dc-c9fa-4dfb-98fb-cd90847fedb0 admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.367976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-d9ff9a10-da4a-405b-8ae6-58f27c99c33e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:47:47.367976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jun 04 20:47:47.367976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jun 04 20:47:47.371022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff9a10-da4a-405b-8ae6-58f27c99c33e admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.379121 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 591/1170] 10.222.0.24 () {58 vars in 1121 bytes} [Sat Jun 4 20:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:47:47.384022 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cd3dc-c9fa-4dfb-98fb-cd90847fedb0 admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.386319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 580/1171] 10.222.0.24 () {60 vars in 1482 bytes} [Sat Jun 4 20:47:47 2022] PUT /identity/v3/projects/ce190dcb329c4cc7b5a0dc4ebe5bfabd/users/eef267c708bf41eda4e2b3aaa7a0f0e4/roles/52b41e61eb19402aa67a7defc45d7f5f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:47:47.392039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f98a11-b1aa-4f55-8e0d-e670bf7a03a4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.392332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f98a11-b1aa-4f55-8e0d-e670bf7a03a4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.392650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f98a11-b1aa-4f55-8e0d-e670bf7a03a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.394062 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9cd3dc-c9fa-4dfb-98fb-cd90847fedb0 admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.403536 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:47.410887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c8f98a11-b1aa-4f55-8e0d-e670bf7a03a4 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:47:47.412177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c8f98a11-b1aa-4f55-8e0d-e670bf7a03a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:47:47.424933 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:47.457074 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6002ece9-796f-462d-adcb-354a11c873c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.458274 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002ece9-796f-462d-adcb-354a11c873c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.458552 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002ece9-796f-462d-adcb-354a11c873c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.458855 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6002ece9-796f-462d-adcb-354a11c873c6 admin admin] PATH_INFO: `/v3/projects/e58e29ef84a8482cb7f83fc149b6a8c2/users/e37a72618f0f41fc8a3d07e1ebeecfb3/roles/52b41e61eb19402aa67a7defc45d7f5f` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.473695 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002ece9-796f-462d-adcb-354a11c873c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e58e29ef84a8482cb7f83fc149b6a8c2, user_id=e37a72618f0f41fc8a3d07e1ebeecfb3, role_id=52b41e61eb19402aa67a7defc45d7f5f)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.475961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 581/1172] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:47:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:47:47.476753 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6002ece9-796f-462d-adcb-354a11c873c6 admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.486597 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f98a11-b1aa-4f55-8e0d-e670bf7a03a4 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.493054 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 592/1173] 10.222.0.24 () {60 vars in 1482 bytes} [Sat Jun 4 20:47:47 2022] PUT /identity/v3/projects/e58e29ef84a8482cb7f83fc149b6a8c2/users/e37a72618f0f41fc8a3d07e1ebeecfb3/roles/52b41e61eb19402aa67a7defc45d7f5f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:47:47.498506 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ff0f-c565-45bc-bfb2-38aac0afa776 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.498800 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ff0f-c565-45bc-bfb2-38aac0afa776 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.499078 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ff0f-c565-45bc-bfb2-38aac0afa776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.516412 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-6eb2ff0f-c565-45bc-bfb2-38aac0afa776 None None] MFA Rules not processed for user `64937d35ffd9426ca7084e0272d22ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:47:47.517681 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-6eb2ff0f-c565-45bc-bfb2-38aac0afa776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:47:47.546465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f98a11-b1aa-4f55-8e0d-e670bf7a03a4 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.578147 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 593/1174] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:47:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:47:47.589768 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ff0f-c565-45bc-bfb2-38aac0afa776 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:47.595890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b3388a-424c-488f-bb7e-5583b72cb737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.596594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3388a-424c-488f-bb7e-5583b72cb737 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.596880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3388a-424c-488f-bb7e-5583b72cb737 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.597159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b3388a-424c-488f-bb7e-5583b72cb737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.606541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3388a-424c-488f-bb7e-5583b72cb737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.608004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b3388a-424c-488f-bb7e-5583b72cb737 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.618064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 582/1175] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:47:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:47:47.645171 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ff0f-c565-45bc-bfb2-38aac0afa776 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:47.649315 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d563d50-99b7-4a27-9cd4-80eb873baceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:47.649975 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563d50-99b7-4a27-9cd4-80eb873baceb service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:47.650254 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563d50-99b7-4a27-9cd4-80eb873baceb service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:47.650533 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d563d50-99b7-4a27-9cd4-80eb873baceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:47.660336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d563d50-99b7-4a27-9cd4-80eb873baceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:47.661833 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d563d50-99b7-4a27-9cd4-80eb873baceb service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:47.673190 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 594/1176] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:47:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:47:53.103435 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283d1b-0c93-4ef2-bb04-73415e8962b9 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.104014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283d1b-0c93-4ef2-bb04-73415e8962b9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.104244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4283d1b-0c93-4ef2-bb04-73415e8962b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:53.141732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a4283d1b-0c93-4ef2-bb04-73415e8962b9 None None] MFA Rules not processed for user `eef267c708bf41eda4e2b3aaa7a0f0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:47:53.143210 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a4283d1b-0c93-4ef2-bb04-73415e8962b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:47:53.231084 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b734-281a-4fd4-9b96-6ea6534aec60 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.231673 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b734-281a-4fd4-9b96-6ea6534aec60 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.231673 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3b734-281a-4fd4-9b96-6ea6534aec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:53.248897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 583/1177] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:47:53 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:47:53.253741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4283d1b-0c93-4ef2-bb04-73415e8962b9 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:53.266054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4283d1b-0c93-4ef2-bb04-73415e8962b9 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:53.271322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bf651-4e31-481c-ac68-3d8053840694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:53.272001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bf651-4e31-481c-ac68-3d8053840694 admin admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.272285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bf651-4e31-481c-ac68-3d8053840694 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.272696 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-fbd3b734-281a-4fd4-9b96-6ea6534aec60 None None] MFA Rules not processed for user `e37a72618f0f41fc8a3d07e1ebeecfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:47:53.273416 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517bf651-4e31-481c-ac68-3d8053840694 admin admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:53.274357 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-fbd3b734-281a-4fd4-9b96-6ea6534aec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:47:53.274484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bf651-4e31-481c-ac68-3d8053840694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:53.275230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-517bf651-4e31-481c-ac68-3d8053840694 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:47:53.275230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jun 04 20:47:53.275230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jun 04 20:47:53.277451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517bf651-4e31-481c-ac68-3d8053840694 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:53.281095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:53.310845 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:53.335052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 584/1178] 10.222.0.24 () {60 vars in 1152 bytes} [Sat Jun 4 20:47:53 2022] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:47:53.336989 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bf651-4e31-481c-ac68-3d8053840694 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:53.381371 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 595/1179] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:47:53 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:47:53.382717 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b734-281a-4fd4-9b96-6ea6534aec60 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:53.399080 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3b734-281a-4fd4-9b96-6ea6534aec60 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:53.455657 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517bf651-4e31-481c-ac68-3d8053840694 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:53.471759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f7cae-3f2f-4747-959a-a21b760e9b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:53.473184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7cae-3f2f-4747-959a-a21b760e9b95 admin admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.473828 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7cae-3f2f-4747-959a-a21b760e9b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.475031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7cae-3f2f-4747-959a-a21b760e9b95 admin admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:53.475031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f7cae-3f2f-4747-959a-a21b760e9b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:53.477637 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71f7cae-3f2f-4747-959a-a21b760e9b95 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:53.507266 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 585/1180] 10.222.0.24 () {60 vars in 1143 bytes} [Sat Jun 4 20:47:53 2022] POST /identity/v3/users => generated 296 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:47:53.512415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f7cae-3f2f-4747-959a-a21b760e9b95 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:53.513166 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882c267-603b-4256-b655-6c51753048df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:53.515112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882c267-603b-4256-b655-6c51753048df admin admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.515537 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882c267-603b-4256-b655-6c51753048df admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.516297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3882c267-603b-4256-b655-6c51753048df admin admin] PATH_INFO: `/v3/projects` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:53.517122 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882c267-603b-4256-b655-6c51753048df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:53.519151 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3882c267-603b-4256-b655-6c51753048df admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:53.529638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71f7cae-3f2f-4747-959a-a21b760e9b95 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:53.536049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ed03d-f6e6-4437-9582-8c06659db604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:53.537088 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ed03d-f6e6-4437-9582-8c06659db604 admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.537785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ed03d-f6e6-4437-9582-8c06659db604 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.537785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ed03d-f6e6-4437-9582-8c06659db604 admin admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:53.538824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ed03d-f6e6-4437-9582-8c06659db604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:53.540988 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ed03d-f6e6-4437-9582-8c06659db604 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:53.555606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 586/1181] 10.222.0.24 () {58 vars in 1121 bytes} [Sat Jun 4 20:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:47:53.560317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ed03d-f6e6-4437-9582-8c06659db604 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:53.572989 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ed03d-f6e6-4437-9582-8c06659db604 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:53.580375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 596/1182] 10.222.0.24 () {60 vars in 1152 bytes} [Sat Jun 4 20:47:53 2022] POST /identity/v3/projects => generated 385 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 04 20:47:53.583861 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882c267-603b-4256-b655-6c51753048df admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:53.648497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563a371-1d82-4717-94aa-21155db02755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:53.649676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a371-1d82-4717-94aa-21155db02755 admin admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.649850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a371-1d82-4717-94aa-21155db02755 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.650218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2563a371-1d82-4717-94aa-21155db02755 admin admin] PATH_INFO: `/v3/projects/eab8562a8ead43bd981cdd145b45ba89/users/e4d9401b40fc4c129a775a252f685b88/roles/f315b062be7e445fa9461a116f9c46ee` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:53.668021 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563a371-1d82-4717-94aa-21155db02755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab8562a8ead43bd981cdd145b45ba89, user_id=e4d9401b40fc4c129a775a252f685b88, role_id=f315b062be7e445fa9461a116f9c46ee)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:53.671332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2563a371-1d82-4717-94aa-21155db02755 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:53.677647 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3882c267-603b-4256-b655-6c51753048df admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:53.683911 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b98ed-ea46-4965-b60c-a0cda1aa8d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:53.684726 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b98ed-ea46-4965-b60c-a0cda1aa8d84 admin admin] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.686144 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b98ed-ea46-4965-b60c-a0cda1aa8d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.686511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b98ed-ea46-4965-b60c-a0cda1aa8d84 admin admin] PATH_INFO: `/v3/users` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:53.687336 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b98ed-ea46-4965-b60c-a0cda1aa8d84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:53.689305 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b98ed-ea46-4965-b60c-a0cda1aa8d84 admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:53.699328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 587/1183] 10.222.0.24 () {60 vars in 1482 bytes} [Sat Jun 4 20:47:53 2022] PUT /identity/v3/projects/eab8562a8ead43bd981cdd145b45ba89/users/e4d9401b40fc4c129a775a252f685b88/roles/f315b062be7e445fa9461a116f9c46ee => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:47:53.700542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563a371-1d82-4717-94aa-21155db02755 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:53.730171 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 597/1184] 10.222.0.24 () {60 vars in 1143 bytes} [Sat Jun 4 20:47:53 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 04 20:47:53.731566 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b98ed-ea46-4965-b60c-a0cda1aa8d84 admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:53.747555 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b98ed-ea46-4965-b60c-a0cda1aa8d84 admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:53.771992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:53.796982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2563a371-1d82-4717-94aa-21155db02755 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:53.804346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795dd1f-fa55-4591-8af6-df4359b78623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:53.805305 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795dd1f-fa55-4591-8af6-df4359b78623 admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.805920 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795dd1f-fa55-4591-8af6-df4359b78623 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.806346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1795dd1f-fa55-4591-8af6-df4359b78623 admin admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:53.807242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795dd1f-fa55-4591-8af6-df4359b78623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:53.809310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1795dd1f-fa55-4591-8af6-df4359b78623 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:53.814659 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:47:53.826698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 588/1185] 10.222.0.24 () {58 vars in 1121 bytes} [Sat Jun 4 20:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:47:53.831083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795dd1f-fa55-4591-8af6-df4359b78623 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:53.842452 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7658129-db52-4dd7-a681-2dbfff4b3058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:53.842738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1795dd1f-fa55-4591-8af6-df4359b78623 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:53.843384 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7658129-db52-4dd7-a681-2dbfff4b3058 admin admin] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.843821 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7658129-db52-4dd7-a681-2dbfff4b3058 admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.844170 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7658129-db52-4dd7-a681-2dbfff4b3058 admin admin] PATH_INFO: `/v3/roles` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:53.845035 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7658129-db52-4dd7-a681-2dbfff4b3058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:53.846752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7658129-db52-4dd7-a681-2dbfff4b3058 admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:53.847637 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601c285-e095-4067-b2ad-a36c68c885a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:53.848591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c285-e095-4067-b2ad-a36c68c885a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.848876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c285-e095-4067-b2ad-a36c68c885a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.849851 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c601c285-e095-4067-b2ad-a36c68c885a8 admin admin] PATH_INFO: `/v3/projects/eab8562a8ead43bd981cdd145b45ba89/users/e4d9401b40fc4c129a775a252f685b88/roles/f315b062be7e445fa9461a116f9c46ee` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:53.851503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601c285-e095-4067-b2ad-a36c68c885a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab8562a8ead43bd981cdd145b45ba89, user_id=e4d9401b40fc4c129a775a252f685b88, role_id=f315b062be7e445fa9461a116f9c46ee)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:53.854522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c601c285-e095-4067-b2ad-a36c68c885a8 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:53.864503 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 598/1186] 10.222.0.24 () {58 vars in 1121 bytes} [Sat Jun 4 20:47:53 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 04 20:47:53.866770 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7658129-db52-4dd7-a681-2dbfff4b3058 admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:53.873658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 589/1187] 10.222.0.24 () {60 vars in 1482 bytes} [Sat Jun 4 20:47:53 2022] PUT /identity/v3/projects/eab8562a8ead43bd981cdd145b45ba89/users/e4d9401b40fc4c129a775a252f685b88/roles/f315b062be7e445fa9461a116f9c46ee => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:47:53.882767 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7658129-db52-4dd7-a681-2dbfff4b3058 admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:53.991120 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc020a-7f41-4cfe-b72c-82008462b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:53.991979 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc020a-7f41-4cfe-b72c-82008462b16c admin admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:53.992327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc020a-7f41-4cfe-b72c-82008462b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:53.992694 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc020a-7f41-4cfe-b72c-82008462b16c admin admin] PATH_INFO: `/v3/projects/72de8dad43bc432d9a7875dcd5fe0c28/users/c1afe7cbfe8840f48e8f1f048b9252e5/roles/f315b062be7e445fa9461a116f9c46ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:54.021787 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc020a-7f41-4cfe-b72c-82008462b16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=72de8dad43bc432d9a7875dcd5fe0c28, user_id=c1afe7cbfe8840f48e8f1f048b9252e5, role_id=f315b062be7e445fa9461a116f9c46ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:54.024836 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc020a-7f41-4cfe-b72c-82008462b16c admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:54.042697 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 599/1188] 10.222.0.24 () {60 vars in 1482 bytes} [Sat Jun 4 20:47:53 2022] PUT /identity/v3/projects/72de8dad43bc432d9a7875dcd5fe0c28/users/c1afe7cbfe8840f48e8f1f048b9252e5/roles/f315b062be7e445fa9461a116f9c46ee => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:47:54.047649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601c285-e095-4067-b2ad-a36c68c885a8 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:54.064470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c601c285-e095-4067-b2ad-a36c68c885a8 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:54.171030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155b937-676a-49a8-b2c3-e708c7bb8ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:54.171030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155b937-676a-49a8-b2c3-e708c7bb8ccd admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:54.171030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155b937-676a-49a8-b2c3-e708c7bb8ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:54.171030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155b937-676a-49a8-b2c3-e708c7bb8ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:54.171998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155b937-676a-49a8-b2c3-e708c7bb8ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:54.171998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155b937-676a-49a8-b2c3-e708c7bb8ccd admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:54.191338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 590/1189] 10.222.0.24 () {58 vars in 1121 bytes} [Sat Jun 4 20:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 04 20:47:54.197755 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc020a-7f41-4cfe-b72c-82008462b16c admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:47:54.213339 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc020a-7f41-4cfe-b72c-82008462b16c admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:47:54.220497 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9160b3-0e9d-4da8-a05d-fc9ce08082ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:47:54.221627 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9160b3-0e9d-4da8-a05d-fc9ce08082ed admin admin] REQUEST_METHOD: `PUT` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:47:54.221802 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9160b3-0e9d-4da8-a05d-fc9ce08082ed admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:47:54.222196 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9160b3-0e9d-4da8-a05d-fc9ce08082ed admin admin] PATH_INFO: `/v3/projects/72de8dad43bc432d9a7875dcd5fe0c28/users/c1afe7cbfe8840f48e8f1f048b9252e5/roles/f315b062be7e445fa9461a116f9c46ee` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:47:54.228149 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9160b3-0e9d-4da8-a05d-fc9ce08082ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=72de8dad43bc432d9a7875dcd5fe0c28, user_id=c1afe7cbfe8840f48e8f1f048b9252e5, role_id=f315b062be7e445fa9461a116f9c46ee)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:47:54.240223 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9160b3-0e9d-4da8-a05d-fc9ce08082ed admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:47:54.268903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 600/1190] 10.222.0.24 () {60 vars in 1482 bytes} [Sat Jun 4 20:47:54 2022] PUT /identity/v3/projects/72de8dad43bc432d9a7875dcd5fe0c28/users/c1afe7cbfe8840f48e8f1f048b9252e5/roles/f315b062be7e445fa9461a116f9c46ee => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:48:00.416241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed864-7dac-438f-9bf2-ff99bfa7fe6b None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:00.417345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed864-7dac-438f-9bf2-ff99bfa7fe6b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:00.417784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ed864-7dac-438f-9bf2-ff99bfa7fe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:00.459860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-970ed864-7dac-438f-9bf2-ff99bfa7fe6b None None] MFA Rules not processed for user `e4d9401b40fc4c129a775a252f685b88`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:00.461526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-970ed864-7dac-438f-9bf2-ff99bfa7fe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:00.579077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 591/1191] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:48:00 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:48:00.592285 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9160b3-0e9d-4da8-a05d-fc9ce08082ed admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:48:00.596787 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-2a9160b3-0e9d-4da8-a05d-fc9ce08082ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:00.763513 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9160b3-0e9d-4da8-a05d-fc9ce08082ed admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:48:00.768193 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df32e6-c4e5-4fa7-a50c-bde7b5b01b87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070dbe04e894424f99365e998376144e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:48:00.769475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df32e6-c4e5-4fa7-a50c-bde7b5b01b87 service glance] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:00.769475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df32e6-c4e5-4fa7-a50c-bde7b5b01b87 service glance] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:00.770045 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df32e6-c4e5-4fa7-a50c-bde7b5b01b87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:00.875327 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:48:00.887707 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df32e6-c4e5-4fa7-a50c-bde7b5b01b87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:48:00.889769 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df32e6-c4e5-4fa7-a50c-bde7b5b01b87 service glance] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:48:00.917369 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 601/1192] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:48:00 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:48:01.114679 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c25d3a-0266-4de3-ab15-7f902cd33783 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:01.119587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c25d3a-0266-4de3-ab15-7f902cd33783 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:01.120058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c25d3a-0266-4de3-ab15-7f902cd33783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:01.187722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e5c25d3a-0266-4de3-ab15-7f902cd33783 None None] MFA Rules not processed for user `c1afe7cbfe8840f48e8f1f048b9252e5`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:01.189233 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e5c25d3a-0266-4de3-ab15-7f902cd33783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:01.281146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:48:01.372139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 592/1193] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:48:01 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:48:01.386572 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df32e6-c4e5-4fa7-a50c-bde7b5b01b87 service glance] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:48:01.399651 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df32e6-c4e5-4fa7-a50c-bde7b5b01b87 service glance] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:48:01.408545 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfc54e-3772-42c1-a8c1-8464caa6a20f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070dbe04e894424f99365e998376144e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:48:01.409234 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfc54e-3772-42c1-a8c1-8464caa6a20f service glance] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:01.409515 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfc54e-3772-42c1-a8c1-8464caa6a20f service glance] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:01.409791 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfc54e-3772-42c1-a8c1-8464caa6a20f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:01.542869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfc54e-3772-42c1-a8c1-8464caa6a20f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:48:01.545247 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dfc54e-3772-42c1-a8c1-8464caa6a20f service glance] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:48:01.565808 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 602/1194] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:48:01 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:48:09.615614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6914465-a9ad-4d79-8f63-c3a1a1806778 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:09.616139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6914465-a9ad-4d79-8f63-c3a1a1806778 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:09.616229 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6914465-a9ad-4d79-8f63-c3a1a1806778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:09.641856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f6914465-a9ad-4d79-8f63-c3a1a1806778 None None] MFA Rules not processed for user `e37a72618f0f41fc8a3d07e1ebeecfb3`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:09.641856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f6914465-a9ad-4d79-8f63-c3a1a1806778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:09.643661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 593/1195] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:48:09 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:48:09.932895 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af6fcb-e315-448c-a4e4-6318b7ad6ddf None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:09.933504 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af6fcb-e315-448c-a4e4-6318b7ad6ddf None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:09.933504 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4af6fcb-e315-448c-a4e4-6318b7ad6ddf None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:09.934829 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 603/1196] 10.222.0.24 () {54 vars in 961 bytes} [Sat Jun 4 20:48:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:48:09.941900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333a225-5adb-473d-9ead-7c541151b23e None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:09.942323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333a225-5adb-473d-9ead-7c541151b23e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:09.943060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e333a225-5adb-473d-9ead-7c541151b23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:09.978420 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e333a225-5adb-473d-9ead-7c541151b23e None None] MFA Rules not processed for user `b82d01982ea7412aa396b517ed80bd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:09.980007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e333a225-5adb-473d-9ead-7c541151b23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:10.049176 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 594/1197] 10.222.0.24 () {58 vars in 1058 bytes} [Sat Jun 4 20:48:09 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:48:10.055082 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a5de-22a6-4bea-a247-635f78934614 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:10.055375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a5de-22a6-4bea-a247-635f78934614 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:10.055657 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a5de-22a6-4bea-a247-635f78934614 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:10.057067 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 604/1198] 10.222.0.24 () {54 vars in 912 bytes} [Sat Jun 4 20:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:48:10.062761 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658a921-f004-40ce-91c8-d9a537f771fe None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:10.063060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658a921-f004-40ce-91c8-d9a537f771fe None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:10.063380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3658a921-f004-40ce-91c8-d9a537f771fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:10.086965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-3658a921-f004-40ce-91c8-d9a537f771fe None None] MFA Rules not processed for user `b82d01982ea7412aa396b517ed80bd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:10.088232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-3658a921-f004-40ce-91c8-d9a537f771fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:10.097304 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 595/1199] 10.222.0.24 () {58 vars in 1009 bytes} [Sat Jun 4 20:48:10 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:48:10.109539 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116a5de-22a6-4bea-a247-635f78934614 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:48:10.111332 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-b116a5de-22a6-4bea-a247-635f78934614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:10.125465 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116a5de-22a6-4bea-a247-635f78934614 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:48:10.134438 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec607f0-e84f-4ec5-a603-5c5a3015bebb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '070dbe04e894424f99365e998376144e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:48:10.135326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec607f0-e84f-4ec5-a603-5c5a3015bebb service glance] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:10.135735 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec607f0-e84f-4ec5-a603-5c5a3015bebb service glance] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:10.136101 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec607f0-e84f-4ec5-a603-5c5a3015bebb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:10.154652 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec607f0-e84f-4ec5-a603-5c5a3015bebb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:48:10.157566 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec607f0-e84f-4ec5-a603-5c5a3015bebb service glance] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:48:10.173812 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 605/1200] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:48:10 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:48:10.688996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4bf2f-2c74-4981-8075-ccc0a745c301 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:10.689519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4bf2f-2c74-4981-8075-ccc0a745c301 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:10.689519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4bf2f-2c74-4981-8075-ccc0a745c301 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:10.691492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 596/1201] 10.222.0.24 () {54 vars in 912 bytes} [Sat Jun 4 20:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:48:10.696860 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c46c4-a269-441d-87f5-a75940fccebd None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:10.697435 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c46c4-a269-441d-87f5-a75940fccebd None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:10.698056 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5c46c4-a269-441d-87f5-a75940fccebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:10.726612 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-8f5c46c4-a269-441d-87f5-a75940fccebd None None] MFA Rules not processed for user `75a7632fe5b5474ab6afd5b3d1bee4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:10.727830 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-8f5c46c4-a269-441d-87f5-a75940fccebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:10.813138 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 606/1202] 10.222.0.24 () {58 vars in 1009 bytes} [Sat Jun 4 20:48:10 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:48:10.825027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4bf2f-2c74-4981-8075-ccc0a745c301 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:48:10.837900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4bf2f-2c74-4981-8075-ccc0a745c301 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:48:10.843084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545eff70-39ce-4a2d-8a37-4479a8cd0e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:48:10.844471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eff70-39ce-4a2d-8a37-4479a8cd0e23 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:10.844873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eff70-39ce-4a2d-8a37-4479a8cd0e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:10.845879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545eff70-39ce-4a2d-8a37-4479a8cd0e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:10.857804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545eff70-39ce-4a2d-8a37-4479a8cd0e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:48:10.859784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545eff70-39ce-4a2d-8a37-4479a8cd0e23 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:48:10.869411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 597/1203] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:48:10 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:48:11.451312 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18126a-e1e0-46ee-abd2-06f9ef2e9037 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:11.451905 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18126a-e1e0-46ee-abd2-06f9ef2e9037 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:11.451905 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18126a-e1e0-46ee-abd2-06f9ef2e9037 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:11.453806 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 607/1204] 10.222.0.24 () {54 vars in 961 bytes} [Sat Jun 4 20:48:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:48:11.468835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4538e-bca8-4b4f-a004-0f72d12822df None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:11.469377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4538e-bca8-4b4f-a004-0f72d12822df None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:11.469826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d4538e-bca8-4b4f-a004-0f72d12822df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:11.502270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-39d4538e-bca8-4b4f-a004-0f72d12822df None None] MFA Rules not processed for user `b82d01982ea7412aa396b517ed80bd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:11.504145 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982c922-48a2-4074-b16c-f11a5d9cb290 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:11.504853 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982c922-48a2-4074-b16c-f11a5d9cb290 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:11.507291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5982c922-48a2-4074-b16c-f11a5d9cb290 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:11.509073 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 608/1205] 10.222.0.24 () {54 vars in 960 bytes} [Sat Jun 4 20:48:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:48:11.510854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-39d4538e-bca8-4b4f-a004-0f72d12822df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:11.515067 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6534d4-4c10-4885-af36-4dc7679b161b None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:11.515770 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6534d4-4c10-4885-af36-4dc7679b161b None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:11.516379 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6534d4-4c10-4885-af36-4dc7679b161b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:11.547810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 598/1206] 10.222.0.24 () {58 vars in 1058 bytes} [Sat Jun 4 20:48:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:48:11.553580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013fd09-759b-461b-ba5f-6ef79fc24263 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:11.554129 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013fd09-759b-461b-ba5f-6ef79fc24263 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:11.554551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013fd09-759b-461b-ba5f-6ef79fc24263 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:11.556871 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-9a6534d4-4c10-4885-af36-4dc7679b161b None None] MFA Rules not processed for user `22f68848269a453289f64d57415fcee5`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:11.557664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 599/1207] 10.222.0.24 () {54 vars in 912 bytes} [Sat Jun 4 20:48:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:48:11.559170 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-9a6534d4-4c10-4885-af36-4dc7679b161b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:11.563137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473ee04-2b2a-48bc-8b31-c3c609958e42 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:11.563612 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473ee04-2b2a-48bc-8b31-c3c609958e42 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:11.564020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473ee04-2b2a-48bc-8b31-c3c609958e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:11.601433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-8473ee04-2b2a-48bc-8b31-c3c609958e42 None None] MFA Rules not processed for user `b82d01982ea7412aa396b517ed80bd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:11.602723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-8473ee04-2b2a-48bc-8b31-c3c609958e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:11.624703 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 600/1208] 10.222.0.24 () {58 vars in 1009 bytes} [Sat Jun 4 20:48:11 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:48:11.642270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473ee04-2b2a-48bc-8b31-c3c609958e42 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:48:11.691163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473ee04-2b2a-48bc-8b31-c3c609958e42 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:48:11.704208 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39aed2-0373-4a36-a434-8cc5dba0cd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:48:11.706016 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39aed2-0373-4a36-a434-8cc5dba0cd0b service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:11.706538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39aed2-0373-4a36-a434-8cc5dba0cd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:11.707186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39aed2-0373-4a36-a434-8cc5dba0cd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:11.720463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39aed2-0373-4a36-a434-8cc5dba0cd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:48:11.722371 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39aed2-0373-4a36-a434-8cc5dba0cd0b service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:48:11.748966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 601/1209] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:48:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:48:11.763951 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 609/1210] 10.222.0.24 () {58 vars in 1057 bytes} [Sat Jun 4 20:48:11 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:48:11.772144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39aed2-0373-4a36-a434-8cc5dba0cd0b service neutron] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:48:11.790744 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39aed2-0373-4a36-a434-8cc5dba0cd0b service neutron] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:48:11.811866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8562d-8654-41d1-ae0a-598bbff1fdd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f68848269a453289f64d57415fcee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:48:11.813192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8562d-8654-41d1-ae0a-598bbff1fdd6 service placement] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:11.813369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8562d-8654-41d1-ae0a-598bbff1fdd6 service placement] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:11.813853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8562d-8654-41d1-ae0a-598bbff1fdd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:11.819359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0fa8562d-8654-41d1-ae0a-598bbff1fdd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:11.837887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8562d-8654-41d1-ae0a-598bbff1fdd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:48:11.846731 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa8562d-8654-41d1-ae0a-598bbff1fdd6 service placement] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:48:11.881722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 602/1211] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:48:11 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:48:21.728118 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=90 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:48:21.795949 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc819b3-1416-453a-aa6c-2dbec21f4f88 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:21.796260 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc819b3-1416-453a-aa6c-2dbec21f4f88 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:21.796654 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc819b3-1416-453a-aa6c-2dbec21f4f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:21.816380 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-9fc819b3-1416-453a-aa6c-2dbec21f4f88 None None] MFA Rules not processed for user `75a7632fe5b5474ab6afd5b3d1bee4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:21.817634 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-9fc819b3-1416-453a-aa6c-2dbec21f4f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:21.825064 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 610/1212] 10.222.0.45 () {58 vars in 1015 bytes} [Sat Jun 4 20:48:21 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:48:21.837316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8562d-8654-41d1-ae0a-598bbff1fdd6 service placement] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:48:21.839030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0fa8562d-8654-41d1-ae0a-598bbff1fdd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:21.853207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8562d-8654-41d1-ae0a-598bbff1fdd6 service placement] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:48:21.857572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab89df-f1bc-4943-97d5-94ea3df305c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:48:21.858245 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab89df-f1bc-4943-97d5-94ea3df305c3 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:21.858520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab89df-f1bc-4943-97d5-94ea3df305c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:21.858823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab89df-f1bc-4943-97d5-94ea3df305c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:21.867323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab89df-f1bc-4943-97d5-94ea3df305c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:48:21.869147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab89df-f1bc-4943-97d5-94ea3df305c3 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:48:21.877124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 603/1213] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:48:21 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:48:22.847033 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631965-f2f4-4757-bc68-a28b28ecdd42 None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:22.847655 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631965-f2f4-4757-bc68-a28b28ecdd42 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:22.847655 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74631965-f2f4-4757-bc68-a28b28ecdd42 None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:22.849235 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 611/1214] 10.222.0.24 () {54 vars in 921 bytes} [Sat Jun 4 20:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:48:22.886433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503291-32d5-4050-9aeb-8d4e73f359cc None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:22.887566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503291-32d5-4050-9aeb-8d4e73f359cc None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:22.888182 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b503291-32d5-4050-9aeb-8d4e73f359cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:22.913936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-4b503291-32d5-4050-9aeb-8d4e73f359cc None None] MFA Rules not processed for user `b82d01982ea7412aa396b517ed80bd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:22.915178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-4b503291-32d5-4050-9aeb-8d4e73f359cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:22.925993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 604/1215] 10.222.0.24 () {58 vars in 1018 bytes} [Sat Jun 4 20:48:22 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 04 20:48:22.962425 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74631965-f2f4-4757-bc68-a28b28ecdd42 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:48:22.979396 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74631965-f2f4-4757-bc68-a28b28ecdd42 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:48:22.991132 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10813ff1-2c95-445b-9f6f-c142f3edf873 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:48:22.991843 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10813ff1-2c95-445b-9f6f-c142f3edf873 service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:22.992308 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10813ff1-2c95-445b-9f6f-c142f3edf873 service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:22.992630 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10813ff1-2c95-445b-9f6f-c142f3edf873 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:23.007330 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10813ff1-2c95-445b-9f6f-c142f3edf873 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:48:23.009309 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10813ff1-2c95-445b-9f6f-c142f3edf873 service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:48:23.020819 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 612/1216] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:48:22 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:48:29.170475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929daa-802b-4f28-af9e-19f8e5094a3c None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:29.171217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929daa-802b-4f28-af9e-19f8e5094a3c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:29.171217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8929daa-802b-4f28-af9e-19f8e5094a3c None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:29.173641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 605/1217] 10.222.0.24 () {54 vars in 921 bytes} [Sat Jun 4 20:48:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:48:29.181395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a96f2-d5d6-49e8-83f1-e33474f56b7f None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:29.182018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a96f2-d5d6-49e8-83f1-e33474f56b7f None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:29.182018 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a96f2-d5d6-49e8-83f1-e33474f56b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:29.204842 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-9c2a96f2-d5d6-49e8-83f1-e33474f56b7f None None] MFA Rules not processed for user `b82d01982ea7412aa396b517ed80bd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:29.206055 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-9c2a96f2-d5d6-49e8-83f1-e33474f56b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:29.215970 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 613/1218] 10.222.0.24 () {58 vars in 1018 bytes} [Sat Jun 4 20:48:29 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:48:29.232303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929daa-802b-4f28-af9e-19f8e5094a3c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:48:29.248909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8929daa-802b-4f28-af9e-19f8e5094a3c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:48:29.254444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387492a-ad50-4c38-9866-a680c19ef928 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:48:29.255112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387492a-ad50-4c38-9866-a680c19ef928 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:29.255385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387492a-ad50-4c38-9866-a680c19ef928 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:29.255852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387492a-ad50-4c38-9866-a680c19ef928 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:29.265433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387492a-ad50-4c38-9866-a680c19ef928 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:48:29.267059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387492a-ad50-4c38-9866-a680c19ef928 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:48:29.277549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 606/1219] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:48:29 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:48:39.198913 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=12 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:48:39.272855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=90 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:48:39.478259 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a96f2-d5d6-49e8-83f1-e33474f56b7f None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:48:39.489903 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a96f2-d5d6-49e8-83f1-e33474f56b7f None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:48:39.494565 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087932e-7ad6-4228-964c-a3a3ac2dc98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:48:39.495234 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087932e-7ad6-4228-964c-a3a3ac2dc98b service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:39.495520 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087932e-7ad6-4228-964c-a3a3ac2dc98b service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:39.495800 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087932e-7ad6-4228-964c-a3a3ac2dc98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:39.510359 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087932e-7ad6-4228-964c-a3a3ac2dc98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:48:39.511832 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087932e-7ad6-4228-964c-a3a3ac2dc98b service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:48:39.526354 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 614/1220] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:48:39 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:48:41.831664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72fb8e-bfbf-436a-bea8-3b3fa0a7749f None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:41.832310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72fb8e-bfbf-436a-bea8-3b3fa0a7749f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:41.832310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c72fb8e-bfbf-436a-bea8-3b3fa0a7749f None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:41.833992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 607/1221] 10.222.0.24 () {54 vars in 921 bytes} [Sat Jun 4 20:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:48:41.839674 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ff46e-b79b-48af-b08d-9ce9d7f527b0 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:41.840682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ff46e-b79b-48af-b08d-9ce9d7f527b0 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:41.840682 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05ff46e-b79b-48af-b08d-9ce9d7f527b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:41.863248 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-b05ff46e-b79b-48af-b08d-9ce9d7f527b0 None None] MFA Rules not processed for user `b82d01982ea7412aa396b517ed80bd4c`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:48:41.864971 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-b05ff46e-b79b-48af-b08d-9ce9d7f527b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:48:41.876011 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 615/1222] 10.222.0.24 () {58 vars in 1018 bytes} [Sat Jun 4 20:48:41 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:48:41.893757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72fb8e-bfbf-436a-bea8-3b3fa0a7749f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:48:41.913713 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c72fb8e-bfbf-436a-bea8-3b3fa0a7749f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:48:41.922559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996e264-3c72-4012-a0b7-b7b1765ed0b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:48:41.923455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996e264-3c72-4012-a0b7-b7b1765ed0b6 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:48:41.924141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996e264-3c72-4012-a0b7-b7b1765ed0b6 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:48:41.924573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996e264-3c72-4012-a0b7-b7b1765ed0b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:48:41.937568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996e264-3c72-4012-a0b7-b7b1765ed0b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:48:41.939394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c996e264-3c72-4012-a0b7-b7b1765ed0b6 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:48:41.951653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 608/1223] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:48:41 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:48:51.855584 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=9 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:48:51.945877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=6 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:49:03.989411 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58743b1c-0eef-4090-9dd5-ad391879dae0 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:49:03.990125 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58743b1c-0eef-4090-9dd5-ad391879dae0 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:49:03.990125 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58743b1c-0eef-4090-9dd5-ad391879dae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:49:04.013087 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-58743b1c-0eef-4090-9dd5-ad391879dae0 None None] MFA Rules not processed for user `eef267c708bf41eda4e2b3aaa7a0f0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:49:04.014615 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-58743b1c-0eef-4090-9dd5-ad391879dae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:49:04.022234 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 616/1224] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:49:03 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:49:04.380106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea366-06fa-4759-ba78-5549e9b19979 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:49:04.380827 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea366-06fa-4759-ba78-5549e9b19979 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:49:04.380827 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ea366-06fa-4759-ba78-5549e9b19979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:49:04.403137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f68ea366-06fa-4759-ba78-5549e9b19979 None None] MFA Rules not processed for user `75a7632fe5b5474ab6afd5b3d1bee4e6`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:49:04.405086 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f68ea366-06fa-4759-ba78-5549e9b19979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:49:04.417282 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 609/1225] 10.222.0.24 () {58 vars in 1009 bytes} [Sat Jun 4 20:49:04 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:49:04.432551 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58743b1c-0eef-4090-9dd5-ad391879dae0 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:49:04.443242 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58743b1c-0eef-4090-9dd5-ad391879dae0 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:49:04.447818 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0945b-2ad5-4065-b17b-5e1d50c3f5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:49:04.448466 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0945b-2ad5-4065-b17b-5e1d50c3f5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:49:04.448790 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0945b-2ad5-4065-b17b-5e1d50c3f5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:49:04.449052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0945b-2ad5-4065-b17b-5e1d50c3f5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:49:04.456976 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0945b-2ad5-4065-b17b-5e1d50c3f5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:49:04.458511 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0945b-2ad5-4065-b17b-5e1d50c3f5c9 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:49:04.469003 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 617/1226] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:49:04 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:49:14.394364 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:49:14.463681 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=9 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:49:28.585966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7cdac-f92e-4e56-8eeb-23408ffdbf73 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:49:28.586460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7cdac-f92e-4e56-8eeb-23408ffdbf73 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:49:28.586460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7cdac-f92e-4e56-8eeb-23408ffdbf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:49:28.608172 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-5df7cdac-f92e-4e56-8eeb-23408ffdbf73 None None] MFA Rules not processed for user `eef267c708bf41eda4e2b3aaa7a0f0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:49:28.610053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-5df7cdac-f92e-4e56-8eeb-23408ffdbf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:49:28.621613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 610/1227] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:49:28 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:49:38.600410 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:49:42.228678 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd6e35-9635-4404-ba2d-30ec4d9d97d4 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:49:42.229208 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd6e35-9635-4404-ba2d-30ec4d9d97d4 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:49:42.229208 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd6e35-9635-4404-ba2d-30ec4d9d97d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:49:42.249719 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-b0cd6e35-9635-4404-ba2d-30ec4d9d97d4 None None] MFA Rules not processed for user `eef267c708bf41eda4e2b3aaa7a0f0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:49:42.250944 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-b0cd6e35-9635-4404-ba2d-30ec4d9d97d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:49:42.260087 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 618/1228] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:49:42 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:49:52.243613 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=3 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:11.047688 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9986-64c9-4821-ab4d-0afe07882dd0 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:11.049055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9986-64c9-4821-ab4d-0afe07882dd0 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:11.049543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffa9986-64c9-4821-ab4d-0afe07882dd0 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:11.051501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 611/1229] 10.222.0.24 () {54 vars in 921 bytes} [Sat Jun 4 20:50:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:50:11.271475 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35476169-e1aa-459b-8117-ab888d0e80a6 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:11.272037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35476169-e1aa-459b-8117-ab888d0e80a6 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:11.272037 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35476169-e1aa-459b-8117-ab888d0e80a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:11.335166 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-35476169-e1aa-459b-8117-ab888d0e80a6 None None] MFA Rules not processed for user `22f68848269a453289f64d57415fcee5`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:50:11.336414 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-35476169-e1aa-459b-8117-ab888d0e80a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:11.345605 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 619/1230] 10.222.0.24 () {58 vars in 1018 bytes} [Sat Jun 4 20:50:11 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:50:11.365449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9986-64c9-4821-ab4d-0afe07882dd0 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:11.383914 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffa9986-64c9-4821-ab4d-0afe07882dd0 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:11.389281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba7296-f676-44b2-8881-32ddc4e5e4c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f68848269a453289f64d57415fcee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:11.390672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba7296-f676-44b2-8881-32ddc4e5e4c7 service placement] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:11.390997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba7296-f676-44b2-8881-32ddc4e5e4c7 service placement] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:11.391363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba7296-f676-44b2-8881-32ddc4e5e4c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:11.403204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba7296-f676-44b2-8881-32ddc4e5e4c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:11.404995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba7296-f676-44b2-8881-32ddc4e5e4c7 service placement] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:11.418021 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 612/1231] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:50:11 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:50:14.429606 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884a2d0-0cc3-47d0-b586-60714dde1d3e None None] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:14.430178 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884a2d0-0cc3-47d0-b586-60714dde1d3e None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:14.430349 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884a2d0-0cc3-47d0-b586-60714dde1d3e None None] PATH_INFO: `/` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:14.431974 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 620/1232] 10.222.0.24 () {54 vars in 921 bytes} [Sat Jun 4 20:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 04 20:50:14.683768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd22a-2b3e-4354-abcf-aef04439f197 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:14.684542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd22a-2b3e-4354-abcf-aef04439f197 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:14.684542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfd22a-2b3e-4354-abcf-aef04439f197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:14.709483 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-1ebfd22a-2b3e-4354-abcf-aef04439f197 None None] MFA Rules not processed for user `22f68848269a453289f64d57415fcee5`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:50:14.711380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-1ebfd22a-2b3e-4354-abcf-aef04439f197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:14.725543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 613/1233] 10.222.0.24 () {58 vars in 1018 bytes} [Sat Jun 4 20:50:14 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:50:14.741535 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884a2d0-0cc3-47d0-b586-60714dde1d3e None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:14.750668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfd22a-2b3e-4354-abcf-aef04439f197 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:14.763465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfd22a-2b3e-4354-abcf-aef04439f197 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:14.770533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3142d7e-800b-43f4-83e5-0a16f9d9143b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f68848269a453289f64d57415fcee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:14.771273 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3142d7e-800b-43f4-83e5-0a16f9d9143b service placement] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:14.771564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3142d7e-800b-43f4-83e5-0a16f9d9143b service placement] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:14.771909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3142d7e-800b-43f4-83e5-0a16f9d9143b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:14.782770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3142d7e-800b-43f4-83e5-0a16f9d9143b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:14.785047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3142d7e-800b-43f4-83e5-0a16f9d9143b service placement] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:14.800785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 614/1234] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:50:14 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:50:14.836396 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884a2d0-0cc3-47d0-b586-60714dde1d3e None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:14.841387 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:14.842337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:14.842648 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:14.842928 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] PATH_INFO: `/v3/users/e37a72618f0f41fc8a3d07e1ebeecfb3` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:14.844334 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e37a72618f0f41fc8a3d07e1ebeecfb3)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:14.846326 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:14.902319 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e37a72618f0f41fc8a3d07e1ebeecfb3'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:14.903077 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e37a72618f0f41fc8a3d07e1ebeecfb3'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:14.911422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e37a72618f0f41fc8a3d07e1ebeecfb3'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:14.912380 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e37a72618f0f41fc8a3d07e1ebeecfb3'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:14.923261 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e37a72618f0f41fc8a3d07e1ebeecfb3'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:14.945389 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 621/1235] 10.222.0.24 () {58 vars in 1223 bytes} [Sat Jun 4 20:50:14 2022] DELETE /identity/v3/users/e37a72618f0f41fc8a3d07e1ebeecfb3 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:50:15.164561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3142d7e-800b-43f4-83e5-0a16f9d9143b service placement] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:15.179010 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3142d7e-800b-43f4-83e5-0a16f9d9143b service placement] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:15.277805 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:15.278788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:15.279110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:15.279426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] PATH_INFO: `/v3/projects/e58e29ef84a8482cb7f83fc149b6a8c2` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:15.280831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e58e29ef84a8482cb7f83fc149b6a8c2)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:15.283051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:15.339995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e58e29ef84a8482cb7f83fc149b6a8c2', 'request_id': 'req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.346705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e58e29ef84a8482cb7f83fc149b6a8c2', 'request_id': 'req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.354936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e58e29ef84a8482cb7f83fc149b6a8c2', 'request_id': 'req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.374296 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] The token cache is being invalidate because project e58e29ef84a8482cb7f83fc149b6a8c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98933) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:50:15.374587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.375270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.377034 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 615/1236] 10.222.0.24 () {58 vars in 1232 bytes} [Sat Jun 4 20:50:15 2022] DELETE /identity/v3/projects/e58e29ef84a8482cb7f83fc149b6a8c2 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:50:15.382386 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:15.384512 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:15.400974 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d067e8-f88c-40cb-8e71-49ec26be4a28 admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:15.448351 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:15.470571 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a39fe8-74cf-4ba3-8840-b7a349b4390a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:15.471539 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a39fe8-74cf-4ba3-8840-b7a349b4390a admin admin] REQUEST_METHOD: `DELETE` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:15.471865 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a39fe8-74cf-4ba3-8840-b7a349b4390a admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:15.472265 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a39fe8-74cf-4ba3-8840-b7a349b4390a admin admin] PATH_INFO: `/v3/users/c1afe7cbfe8840f48e8f1f048b9252e5` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:15.473520 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a39fe8-74cf-4ba3-8840-b7a349b4390a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1afe7cbfe8840f48e8f1f048b9252e5)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:15.475753 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a39fe8-74cf-4ba3-8840-b7a349b4390a admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:15.536068 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-c7a39fe8-74cf-4ba3-8840-b7a349b4390a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1afe7cbfe8840f48e8f1f048b9252e5'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.536937 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-c7a39fe8-74cf-4ba3-8840-b7a349b4390a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1afe7cbfe8840f48e8f1f048b9252e5'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.545247 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-c7a39fe8-74cf-4ba3-8840-b7a349b4390a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1afe7cbfe8840f48e8f1f048b9252e5'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.546239 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-c7a39fe8-74cf-4ba3-8840-b7a349b4390a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1afe7cbfe8840f48e8f1f048b9252e5'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.554395 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-c7a39fe8-74cf-4ba3-8840-b7a349b4390a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1afe7cbfe8840f48e8f1f048b9252e5'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.575599 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 622/1237] 10.222.0.24 () {58 vars in 1223 bytes} [Sat Jun 4 20:50:15 2022] DELETE /identity/v3/users/c1afe7cbfe8840f48e8f1f048b9252e5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:50:15.786214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:15.788522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:15.806450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a28435d-8b2d-4cd0-bd7e-e28ce62030d6 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:15.876553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:15.885910 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:15.886957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:15.887442 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:15.887887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] PATH_INFO: `/v3/projects/72de8dad43bc432d9a7875dcd5fe0c28` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:15.889596 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=72de8dad43bc432d9a7875dcd5fe0c28)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:15.892072 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:15.948472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72de8dad43bc432d9a7875dcd5fe0c28', 'request_id': 'req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.955191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72de8dad43bc432d9a7875dcd5fe0c28', 'request_id': 'req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.963752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72de8dad43bc432d9a7875dcd5fe0c28', 'request_id': 'req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.979651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] The token cache is being invalidate because project 72de8dad43bc432d9a7875dcd5fe0c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98933) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:50:15.979994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.980905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:50:15.983446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 616/1238] 10.222.0.24 () {58 vars in 1232 bytes} [Sat Jun 4 20:50:15 2022] DELETE /identity/v3/projects/72de8dad43bc432d9a7875dcd5fe0c28 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:50:25.571752 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=33,keystone:DELETE=10,keystone:INSERT=1 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:25.975541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:42.668676 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea1495-ac46-454f-985e-53e857bae2f5 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:42.669235 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea1495-ac46-454f-985e-53e857bae2f5 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:42.669235 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea1495-ac46-454f-985e-53e857bae2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:42.689661 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-74ea1495-ac46-454f-985e-53e857bae2f5 None None] MFA Rules not processed for user `eef267c708bf41eda4e2b3aaa7a0f0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:50:42.690968 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-74ea1495-ac46-454f-985e-53e857bae2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:42.751606 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 623/1239] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:50:42 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:50:52.744189 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=25 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:50:54.377145 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:50:54.379223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:54.462302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0e7e07-b64c-4eeb-9fad-495a4d8876dd admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:50:54.466681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31a954-f663-4501-b48d-d5ce020bd321 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:50:54.467348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a954-f663-4501-b48d-d5ce020bd321 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:50:54.467637 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a954-f663-4501-b48d-d5ce020bd321 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:50:54.467887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31a954-f663-4501-b48d-d5ce020bd321 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:50:54.470108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ca31a954-f663-4501-b48d-d5ce020bd321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:50:54.535769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31a954-f663-4501-b48d-d5ce020bd321 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:50:54.537326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31a954-f663-4501-b48d-d5ce020bd321 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:50:54.547136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 617/1240] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:50:54 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:51:04.542996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=54 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:52:12.774643 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea1495-ac46-454f-985e-53e857bae2f5 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:52:12.776170 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-74ea1495-ac46-454f-985e-53e857bae2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:12.862065 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea1495-ac46-454f-985e-53e857bae2f5 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:52:12.867659 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b495c18f-94cd-4465-999a-77ac0b9df5a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f68848269a453289f64d57415fcee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:52:12.868317 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495c18f-94cd-4465-999a-77ac0b9df5a6 service placement] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:52:12.868657 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495c18f-94cd-4465-999a-77ac0b9df5a6 service placement] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:52:12.868998 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b495c18f-94cd-4465-999a-77ac0b9df5a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:52:12.872214 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-b495c18f-94cd-4465-999a-77ac0b9df5a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:52:12.884639 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495c18f-94cd-4465-999a-77ac0b9df5a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:52:12.886259 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b495c18f-94cd-4465-999a-77ac0b9df5a6 service placement] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:52:12.896526 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 624/1241] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:52:12 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:52:22.892375 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=36 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:02.581310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31a954-f663-4501-b48d-d5ce020bd321 service neutron] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:02.584631 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ca31a954-f663-4501-b48d-d5ce020bd321 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:02.682211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31a954-f663-4501-b48d-d5ce020bd321 service neutron] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:02.688221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0ca1f-fa59-4df0-82d8-597677e39c2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:02.689017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0ca1f-fa59-4df0-82d8-597677e39c2e service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:02.689431 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0ca1f-fa59-4df0-82d8-597677e39c2e service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:02.689825 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c0ca1f-fa59-4df0-82d8-597677e39c2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:02.692086 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-59c0ca1f-fa59-4df0-82d8-597677e39c2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:02.706075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0ca1f-fa59-4df0-82d8-597677e39c2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:02.707957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c0ca1f-fa59-4df0-82d8-597677e39c2e service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:02.718809 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 618/1242] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:02 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:07.799693 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc44c6d-c656-486e-946c-c402abfc45a5 None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:07.800308 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc44c6d-c656-486e-946c-c402abfc45a5 None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:07.800308 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc44c6d-c656-486e-946c-c402abfc45a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:07.821337 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-abc44c6d-c656-486e-946c-c402abfc45a5 None None] MFA Rules not processed for user `eef267c708bf41eda4e2b3aaa7a0f0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:53:07.822618 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-abc44c6d-c656-486e-946c-c402abfc45a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:07.831683 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 625/1243] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:53:07 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:53:09.898243 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0ca1f-fa59-4df0-82d8-597677e39c2e service nova] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:09.900412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-59c0ca1f-fa59-4df0-82d8-597677e39c2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:09.914985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c0ca1f-fa59-4df0-82d8-597677e39c2e service nova] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:09.922777 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2727d1-d5ee-4d1d-a223-7940974dc060 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:09.924116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2727d1-d5ee-4d1d-a223-7940974dc060 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:09.924489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2727d1-d5ee-4d1d-a223-7940974dc060 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:09.924968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2727d1-d5ee-4d1d-a223-7940974dc060 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:09.928587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-2d2727d1-d5ee-4d1d-a223-7940974dc060 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:09.955208 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2727d1-d5ee-4d1d-a223-7940974dc060 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:09.958685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2727d1-d5ee-4d1d-a223-7940974dc060 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:09.985500 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 619/1244] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:09 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:11.112780 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc44c6d-c656-486e-946c-c402abfc45a5 None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:11.125709 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc44c6d-c656-486e-946c-c402abfc45a5 None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:11.130186 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd6a5f-0940-4275-88e3-2c8f5cdc2edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:11.130869 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd6a5f-0940-4275-88e3-2c8f5cdc2edb service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:11.131248 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd6a5f-0940-4275-88e3-2c8f5cdc2edb service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:11.131523 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd6a5f-0940-4275-88e3-2c8f5cdc2edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:11.133713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-36dd6a5f-0940-4275-88e3-2c8f5cdc2edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:11.149112 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd6a5f-0940-4275-88e3-2c8f5cdc2edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:11.150598 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dd6a5f-0940-4275-88e3-2c8f5cdc2edb service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:11.165566 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 626/1245] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:11 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:19.976283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=42 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:21.158721 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=9 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:53:23.553094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2727d1-d5ee-4d1d-a223-7940974dc060 service neutron] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:53:23.570692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2727d1-d5ee-4d1d-a223-7940974dc060 service neutron] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:53:23.577521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252665e-a2c7-4319-9c6a-27c6c4eb988c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:53:23.578548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252665e-a2c7-4319-9c6a-27c6c4eb988c service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:53:23.578993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252665e-a2c7-4319-9c6a-27c6c4eb988c service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:53:23.579431 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252665e-a2c7-4319-9c6a-27c6c4eb988c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:53:23.582466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-8252665e-a2c7-4319-9c6a-27c6c4eb988c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:53:23.599540 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252665e-a2c7-4319-9c6a-27c6c4eb988c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:53:23.602281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252665e-a2c7-4319-9c6a-27c6c4eb988c service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:53:23.617756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 620/1246] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:53:23 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:53:33.611029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=6 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:16.108496 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d368b8-c75d-490e-8366-ca0f51b0ebda None None] REQUEST_METHOD: `POST` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:16.109158 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d368b8-c75d-490e-8366-ca0f51b0ebda None None] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:16.109314 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d368b8-c75d-490e-8366-ca0f51b0ebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:16.143275 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.auth.core [None req-87d368b8-c75d-490e-8366-ca0f51b0ebda None None] MFA Rules not processed for user `eef267c708bf41eda4e2b3aaa7a0f0e4`. Rule list: `[]` (Enabled: `True`). {{(pid=98932) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 04 20:55:16.144582 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-87d368b8-c75d-490e-8366-ca0f51b0ebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:16.178713 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 627/1247] 10.222.0.24 () {58 vars in 957 bytes} [Sat Jun 4 20:55:16 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 04 20:55:16.587526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252665e-a2c7-4319-9c6a-27c6c4eb988c service neutron] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:16.617427 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252665e-a2c7-4319-9c6a-27c6c4eb988c service neutron] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:16.622187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd57d6-13c4-4a09-90ce-430219c74b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:16.623091 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd57d6-13c4-4a09-90ce-430219c74b79 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:16.623561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd57d6-13c4-4a09-90ce-430219c74b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:16.623946 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fd57d6-13c4-4a09-90ce-430219c74b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:16.626409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-14fd57d6-13c4-4a09-90ce-430219c74b79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:16.658726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd57d6-13c4-4a09-90ce-430219c74b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:16.661768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fd57d6-13c4-4a09-90ce-430219c74b79 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:16.677961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 621/1248] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:16 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:17.295897 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d368b8-c75d-490e-8366-ca0f51b0ebda None None] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:17.297947 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-87d368b8-c75d-490e-8366-ca0f51b0ebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:17.327285 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d368b8-c75d-490e-8366-ca0f51b0ebda None None] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:17.335387 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e7022-0ca0-49d5-b460-2a95c1aa41fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f68848269a453289f64d57415fcee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:17.336545 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e7022-0ca0-49d5-b460-2a95c1aa41fd service placement] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:17.337189 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e7022-0ca0-49d5-b460-2a95c1aa41fd service placement] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:17.337810 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e7022-0ca0-49d5-b460-2a95c1aa41fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:17.340323 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-b78e7022-0ca0-49d5-b460-2a95c1aa41fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:17.361186 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e7022-0ca0-49d5-b460-2a95c1aa41fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:17.363196 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e7022-0ca0-49d5-b460-2a95c1aa41fd service placement] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:17.380297 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 628/1249] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:17 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:55:21.741069 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd57d6-13c4-4a09-90ce-430219c74b79 service neutron] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:21.768965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fd57d6-13c4-4a09-90ce-430219c74b79 service neutron] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:21.780379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d6315-33d6-417b-be04-d52c3e9f9bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:21.781599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6315-33d6-417b-be04-d52c3e9f9bfb service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:21.782064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6315-33d6-417b-be04-d52c3e9f9bfb service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:21.782524 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d6315-33d6-417b-be04-d52c3e9f9bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:21.787399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e76d6315-33d6-417b-be04-d52c3e9f9bfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:21.804706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d6315-33d6-417b-be04-d52c3e9f9bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:21.815775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76d6315-33d6-417b-be04-d52c3e9f9bfb service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:21.830059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 622/1250] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:21 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:55:27.371258 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=24 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:27.451766 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e7022-0ca0-49d5-b460-2a95c1aa41fd service placement] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:55:27.469143 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e7022-0ca0-49d5-b460-2a95c1aa41fd service placement] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:55:27.475255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cf1f5-54e9-4fe0-806b-dd329e82107b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b82d01982ea7412aa396b517ed80bd4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:55:27.475939 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cf1f5-54e9-4fe0-806b-dd329e82107b service nova] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:55:27.476229 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cf1f5-54e9-4fe0-806b-dd329e82107b service nova] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:55:27.476542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73cf1f5-54e9-4fe0-806b-dd329e82107b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:55:27.478457 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-f73cf1f5-54e9-4fe0-806b-dd329e82107b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:55:27.492507 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cf1f5-54e9-4fe0-806b-dd329e82107b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:55:27.496262 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73cf1f5-54e9-4fe0-806b-dd329e82107b service nova] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:55:27.512737 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 629/1251] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:55:27 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:55:31.830457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=21 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:55:37.503689 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=6 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:13.605978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d6315-33d6-417b-be04-d52c3e9f9bfb service nova] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:13.620628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d6315-33d6-417b-be04-d52c3e9f9bfb service nova] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:13.626544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f014210-452a-49db-a555-d89deea83416 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f68848269a453289f64d57415fcee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:13.627241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f014210-452a-49db-a555-d89deea83416 service placement] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:13.627533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f014210-452a-49db-a555-d89deea83416 service placement] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:13.627818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f014210-452a-49db-a555-d89deea83416 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:13.638993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f014210-452a-49db-a555-d89deea83416 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:13.640763 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f014210-452a-49db-a555-d89deea83416 service placement] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:13.652498 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 623/1252] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:13 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 04 20:57:23.647618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=6 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:57:55.399426 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cf1f5-54e9-4fe0-806b-dd329e82107b service nova] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:55.410942 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73cf1f5-54e9-4fe0-806b-dd329e82107b service nova] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:55.415253 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1853a0-60ac-4eb5-9cb8-960c2a512940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75a7632fe5b5474ab6afd5b3d1bee4e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:55.416022 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1853a0-60ac-4eb5-9cb8-960c2a512940 service neutron] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:55.416480 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1853a0-60ac-4eb5-9cb8-960c2a512940 service neutron] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:55.416823 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1853a0-60ac-4eb5-9cb8-960c2a512940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:55.419076 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-af1853a0-60ac-4eb5-9cb8-960c2a512940 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:55.532058 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1853a0-60ac-4eb5-9cb8-960c2a512940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:55.533698 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1853a0-60ac-4eb5-9cb8-960c2a512940 service neutron] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:55.545255 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 630/1253] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:57:58.973066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f014210-452a-49db-a555-d89deea83416 service placement] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:57:58.983877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f014210-452a-49db-a555-d89deea83416 service placement] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:57:58.990935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec292457-3741-40ee-95eb-1e1513f4808c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f68848269a453289f64d57415fcee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:57:58.994877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec292457-3741-40ee-95eb-1e1513f4808c service placement] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:57:58.994877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec292457-3741-40ee-95eb-1e1513f4808c service placement] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:57:58.994877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec292457-3741-40ee-95eb-1e1513f4808c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:57:58.994877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ec292457-3741-40ee-95eb-1e1513f4808c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:57:59.008671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec292457-3741-40ee-95eb-1e1513f4808c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:57:59.013128 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec292457-3741-40ee-95eb-1e1513f4808c service placement] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:57:59.036741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 624/1254] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:57:58 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:02.632421 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1853a0-60ac-4eb5-9cb8-960c2a512940 service neutron] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:02.648422 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1853a0-60ac-4eb5-9cb8-960c2a512940 service neutron] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:02.657540 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296c33d-9241-48a4-9a2d-33a30bc1b1c5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22f68848269a453289f64d57415fcee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '793a7b858d3848b3b0df4e9c31d20d2a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:02.658695 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296c33d-9241-48a4-9a2d-33a30bc1b1c5 service placement] REQUEST_METHOD: `GET` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:02.659193 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296c33d-9241-48a4-9a2d-33a30bc1b1c5 service placement] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:02.659670 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296c33d-9241-48a4-9a2d-33a30bc1b1c5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:02.663058 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-0296c33d-9241-48a4-9a2d-33a30bc1b1c5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:02.684937 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296c33d-9241-48a4-9a2d-33a30bc1b1c5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:02.687892 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296c33d-9241-48a4-9a2d-33a30bc1b1c5 service placement] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:02.704232 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 631/1255] 10.222.0.24 () {60 vars in 1365 bytes} [Sat Jun 4 20:58:02 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 04 20:58:02.714704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec292457-3741-40ee-95eb-1e1513f4808c service placement] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:02.717630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ec292457-3741-40ee-95eb-1e1513f4808c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:02.735103 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec292457-3741-40ee-95eb-1e1513f4808c service placement] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:02.741016 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:02.742042 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:02.742323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:02.742594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] PATH_INFO: `/v3/users/eef267c708bf41eda4e2b3aaa7a0f0e4` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:02.769891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef267c708bf41eda4e2b3aaa7a0f0e4)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:02.771329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:58:02.771329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jun 04 20:58:02.771329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jun 04 20:58:02.773949 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:02.851811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef267c708bf41eda4e2b3aaa7a0f0e4'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:02.852459 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef267c708bf41eda4e2b3aaa7a0f0e4'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:02.853111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef267c708bf41eda4e2b3aaa7a0f0e4'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:02.865158 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef267c708bf41eda4e2b3aaa7a0f0e4'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:02.890335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef267c708bf41eda4e2b3aaa7a0f0e4'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:02.909671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 625/1256] 10.222.0.24 () {58 vars in 1223 bytes} [Sat Jun 4 20:58:02 2022] DELETE /identity/v3/users/eef267c708bf41eda4e2b3aaa7a0f0e4 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:03.110854 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296c33d-9241-48a4-9a2d-33a30bc1b1c5 service placement] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:03.129071 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296c33d-9241-48a4-9a2d-33a30bc1b1c5 service placement] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:03.196921 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:03.198177 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:03.198548 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:03.198890 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] PATH_INFO: `/v3/projects/ce190dcb329c4cc7b5a0dc4ebe5bfabd` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:03.212576 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce190dcb329c4cc7b5a0dc4ebe5bfabd)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:03.213879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: WARNING py.warnings [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 04 20:58:03.213879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: warnings.warn(msg) Jun 04 20:58:03.213879 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: Jun 04 20:58:03.215608 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:03.288553 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce190dcb329c4cc7b5a0dc4ebe5bfabd', 'request_id': 'req-c61b1ede-17f1-4ada-a354-bf0195cb1feb'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.293945 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:03.296735 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce190dcb329c4cc7b5a0dc4ebe5bfabd', 'request_id': 'req-c61b1ede-17f1-4ada-a354-bf0195cb1feb'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.309405 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce190dcb329c4cc7b5a0dc4ebe5bfabd', 'request_id': 'req-c61b1ede-17f1-4ada-a354-bf0195cb1feb'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.334562 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] The token cache is being invalidate because project ce190dcb329c4cc7b5a0dc4ebe5bfabd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:58:03.334855 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.335667 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.337449 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 632/1257] 10.222.0.24 () {58 vars in 1232 bytes} [Sat Jun 4 20:58:03 2022] DELETE /identity/v3/projects/ce190dcb329c4cc7b5a0dc4ebe5bfabd => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:58:03.341783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:03.343298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:03.358765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f976d-9b4d-49f4-af2b-8d35a072c628 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:03.431511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cb085-c632-4016-ae37-421e6a747ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:03.432412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cb085-c632-4016-ae37-421e6a747ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:03.432736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cb085-c632-4016-ae37-421e6a747ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:03.433017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cb085-c632-4016-ae37-421e6a747ebe admin admin] PATH_INFO: `/v3/users/e4d9401b40fc4c129a775a252f685b88` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:03.448150 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cb085-c632-4016-ae37-421e6a747ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d9401b40fc4c129a775a252f685b88)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:03.450206 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cb085-c632-4016-ae37-421e6a747ebe admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:03.507366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:03.513317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-290cb085-c632-4016-ae37-421e6a747ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d9401b40fc4c129a775a252f685b88'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.514197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-290cb085-c632-4016-ae37-421e6a747ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d9401b40fc4c129a775a252f685b88'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.514906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-290cb085-c632-4016-ae37-421e6a747ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d9401b40fc4c129a775a252f685b88'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.527039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-290cb085-c632-4016-ae37-421e6a747ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d9401b40fc4c129a775a252f685b88'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.542868 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-290cb085-c632-4016-ae37-421e6a747ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d9401b40fc4c129a775a252f685b88'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.567781 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 626/1258] 10.222.0.24 () {58 vars in 1223 bytes} [Sat Jun 4 20:58:03 2022] DELETE /identity/v3/users/e4d9401b40fc4c129a775a252f685b88 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 04 20:58:03.767052 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] Authenticating user token {{(pid=98932) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 04 20:58:03.769506 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.fernet_utils [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98932) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 04 20:58:03.789802 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b1ede-17f1-4ada-a354-bf0195cb1feb admin admin] Validating token access rules against request {{(pid=98932) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 04 20:58:03.862875 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64937d35ffd9426ca7084e0272d22ff3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a16b8488457e4e38a2b3d336cfdffb59', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98932) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 04 20:58:03.863812 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] REQUEST_METHOD: `DELETE` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 04 20:58:03.864097 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] SCRIPT_NAME: `/identity` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 04 20:58:03.864376 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] PATH_INFO: `/v3/projects/eab8562a8ead43bd981cdd145b45ba89` {{(pid=98932) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 04 20:58:03.877373 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab8562a8ead43bd981cdd145b45ba89)` {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 04 20:58:03.879240 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] RBAC: Authorization granted {{(pid=98932) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 04 20:58:03.938291 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab8562a8ead43bd981cdd145b45ba89', 'request_id': 'req-acc35d36-36ee-4ef0-a162-612d534d1bca'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.947542 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab8562a8ead43bd981cdd145b45ba89', 'request_id': 'req-acc35d36-36ee-4ef0-a162-612d534d1bca'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.960287 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab8562a8ead43bd981cdd145b45ba89', 'request_id': 'req-acc35d36-36ee-4ef0-a162-612d534d1bca'} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.982820 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] The token cache is being invalidate because project eab8562a8ead43bd981cdd145b45ba89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98932) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 04 20:58:03.983320 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.984382 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG keystone.notifications [None req-acc35d36-36ee-4ef0-a162-612d534d1bca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98932) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 04 20:58:03.986980 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: [pid: 98932|app: 0|req: 633/1259] 10.222.0.24 () {58 vars in 1232 bytes} [Sat Jun 4 20:58:03 2022] DELETE /identity/v3/projects/eab8562a8ead43bd981cdd145b45ba89 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 04 20:58:13.555539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:DELETE=5,keystone:SELECT=14,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 04 20:58:13.976545 dv-osbrick-master-4-ceph devstack@keystone.service[98932]: DEBUG dbcounter [-] [98932] Writing DB stats keystone:DELETE=9,keystone:SELECT=60,keystone:INSERT=2 {{(pid=98932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}